Speech and Multimodal Interfaces Laboratory

Publications

2026

Karpov Alexey, Gosztolya Gabor. SPECOM 2025 Preface // Lecture Notes in Computer Science / Proc. 27th International Conference on Speech and Computer SPECOM 2025, Szeged, Hungary. 2026, vol. 16187 / 16188, pp. v–vi.

Markitantov Maxim, Ryumina Elena, Karpov Alexey. Audio-Visual Occlusion-Robust Gender Recognition and Age Estimation Approach Based on Multi-Task Cross-Modal Attention // Expert Systems with Applications. 2026. vol. 296, Part A, 127473.

2025

Markitantov Maxim, Ryumina Elena, Kaya Heysem, Karpov Alexey. Multi-Modal Multi-Task Affective States Recognition Based on Label Encoder Fusion // In Proc. 26th International Conference INTERSPEECH 2025. ISCA, Rotterdam, Netherlands, 2025. pp. 3010–3014.

Mamontov Danila, Karpov Alexey, Minker Wolfgang. A Multilingual Telegram Chatbot for Mental Health Data Collection // In Proc. 27th ACM International Conference on Multimodal Interaction ICMI 2025. ACM, Canberra, Australia, 2025. pp. 794–796.

Ryumina Elena, Ryumin Dmitry, Axyonov Alexandr, Ivanko Denis, Karpov Alexey. Multi-Corpus Emotion Recognition Method based on Cross-Modal Gated Attention Fusion // Pattern Recognition Letters. 2025. vol. 190. pp. 192–200.

Shilov Nikolay, Ponomarev Andrew, Ryumin Dmitry, Karpov Alexey. Generative Adversarial Framework with Composite Discriminator for Organization and Process Modelling—Smart City Cases // Smart Cities. 2025. vol. 8(2), 38.

Ryumina Elena, Axyonov Alexandr, Abdulkadirov Timur, Koryakovskaya Darya, Ryumin Dmitry. Cross-Lingual Bimodal Emotion Recognition with LLM-Based Label Smoothing // Big Data and Cognitive Computing. 2025. vol. 9, 285.

Karpov A.A., Potapova R.K., Potapov V.V. The 26th International Conference “Speech and Computer” SPECOM-2024 // The Bulletin of the Russian Academy of Sciences: Studies in Literature and Language. 2025. Vol. 84, No. 3. pp. 119–126.

Kagirov I.A., Kiseleva K.O., Kipyatkova I.S. Code-switching analysis in Karelian language speakers' speech // Terra Linguistica. 2025. Vol. 16, No. 2. pp. 22–40.

Kipyatkova I.S., Kagirov I.A., Dolgushin M.D. Use of Pre-Trained Multilingual Models for Karelian Speech Recognition // Informatics and Automation. 2025. Vol. 24, No. 2. pp. 604–630.

Dolgushin M.D., Karpov A.A. Analytical Review of Speech and Multimodal Methods for Cognitive Impairments Recognition in People // Informatics and Automation. 2025. Vol. 24, No. 6. pp. 1683–1720.

Axyonov A.A., Ryumina E.V., Ryumin D.A. A method for generating digital avatar animation with speech and non-verbal synchronization based on bimodal data // Scientific and Technical Journal of Information Technologies, Mechanics and Optics. 2025. Vol. 25, No. 4. pp. 651–662.

Velichko A.N., Karpov A.A. A multimodal approach for depression detection using semi-automatic data annotation and deterministic machine learning methods // Scientific and Technical Journal of Information Technologies, Mechanics and Optics. 2025. Vol. 25, No. 6. pp. 1107–1116.

Dolgushin Mikhail, Guseva Daria, Karpov Alexey. Investigation of Explainable Multimodal Methods for Detecting Mental Disorders // Lecture Notes in Computer Science / Proc. 27th International Conference on Speech and Computer SPECOM 2025, Szeged, Hungary. 2026. vol. 16187. pp. 173–187.

Kipyatkova Irina, Kiseleva Kseniia, Dolgushin Mikhail, Kagirov Ildar. Modeling Intra-word Code-Switching for Karelian ASR // Lecture Notes in Computer Science / Proc. 27th International Conference on Speech and Computer SPECOM 2025, Szeged, Hungary. 2026. vol. 16188. pp. 104–117.