Speech and Multimodal Interfaces Laboratory



Ivanko D., Karpov A., Fedotov D., Kipyatkova I., Ryumin D., Ivanko Dm., Minker W., Zelezny M. Multimodal Speech Recognition: Increasing Accuracy using High Speed Video Data // Journal on Multimodal User Interfaces, Springer, Vol. 12, № 4, 2018, pp. 319-328.
Karpov A.A., Yusupov R.M. Multimodal Interfaces of Human-Computer Interaction // Herald of the Russian Academy of Sciences, Springer, Vol. 88, No. 2, 2018, pp. 146-155.
Kaya H., Karpov A. Efficient and Effective Feature Normalization Strategies for Cross-Corpus Acoustic Emotion Recognition // Neurocomputing. Elsevier, Vol. 275, 2018, pp. 1028-1034.


Kipyatkova I. Development and research of neural network hybrid acoustic models for the Russian speech recognition system. Materials of the XXII St. Petersburg Assembly of Young Scientists and Specialists, 2017, p. 201.
Saveliev A. Development of a configuration method for the optimal arrangement of heterogeneous modules of the IoT network. Materials of the XXII St. Petersburg Assembly of Young Scientists and Specialists, 2017, p. 143.
Velichko A., Sokolov B., Karpov A., Budkov V. A brief review of the methods used in paralinguistic analysis of speech. Collection of reports of the 70th international student scientific conference GUAP. Part 2. Technical Sciences, St. Petersburg: GUAP, 2017, pp. 51-53.
Syrkin L., Zuykova A., Karpov A., Usov V. Application of an alternative method of communication for everyday interaction of a person with reduced physical capacity and a robot assistant. Proceedings of the Conference "Cognitive Research at the Present Stage" KISE-2017, Kazan, 2017.
Verkholyak O., Karpov A. Combining utterance-level and frame-level feature representations for emotion classification from speech. In Proc. IEEE International Symposium "Video and Audio Signal Processing in the Context of Neurotechnologies", SPCN-2017, 2017, pp. 31.
Tampel I., Karpov A. Automatic speech recognition. Tutorial - Spb: University of ITMO, 2017, 152 p.
Karasev E., Saveliev A., Malov D. Managing audio and video streams in peer-to-peer videoconferencing applications. Proceedings of the 10th Multi-Conference MCU-2017, vol. 3, 2017, pp. 94-96.
Budkov V., Saveliev A., Basov O., Ronzhin A. Corpus of Russian speech for the study of the truth of the transmitted message // Proceedings of the 7th Interdisciplinary Workshop "Analysis of Conversational Russian Speech" АР3 - 2017, St. Petersburg, 2017, pp. 21-25.
Kryuchkov B., Karpov A., Usov V., Chertopolokhov V. Multi-level monitoring of the gesture control of a mobile robot with out-of-ship activities on the lunar surface. Proceedings of the XIX International Conference "Problems of Control and Modeling in Complex Systems" PUMSS-2017, Samara, 2017, pp. 153-159.
Velichko A., Budkov V., Karpov A. Analytical Survey of Computational Paralinguistic Systems for Automatic Recognition of Deception in Human Speech // Informatsionno-Upravliaiushchie Sistemy, No. 5, 2017, pp. 30-41.
Kipyatkova I., Karpov A. Research of neural network models of the Russian language for automatic speech recognition systems // Avtomatika i Telemekhanika, vol. 78, No. 5, 2017, pp. 110-122.
Kryuchkov B., Usov V., Tchertopolokhov V., Ronzhin A., Karpov A. Simulation of the “cosmonaut-robot” system interaction on the lunar surface based on methods of machine vision and computer graphics. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences. In Proc. ISPRS International Workshop “Photogrammetric and computer vision techniques for video Surveillance, Biometrics and Biomedicine” PSBB-2017, Moscow, 2017, pp. 129-133.