Speech and Multimodal Interfaces Laboratory

Publications

2024

Karpov A., Delić V. SPECOM 2024 Preface // Proc. 26th International Conference on Speech and Computer (SPECOM). 2024. vol. 15299 / 15300. pp. v-vi.
Ryumin D., Axyonov A., Ryumina E., Ivanko D., Kashevnik A., Karpov A. Audio–visual speech recognition based on regulated transformer and spatio–temporal fusion strategy for driver assistive systems // Expert Systems with Applications. 2024. vol. 252. ID 124159.
Ryumina E., Markitantov M., Ryumin D., Karpov A. OCEAN-AI framework with EmoFormer cross-hemiface attention approach for personality traits assessment // Expert Systems with Applications. 2024. vol. 239. ID 122441.
Ryumina E., Markitantov M., Ryumin D., Karpov A. Gated Siamese Fusion Network based on multimodal deep and hand-crafted features for personality traits assessment // Pattern Recognition Letters. 2024. vol. 185. pp. 45-51.
Othman W., Kashevnik A., Ali A., Shilov N., Ryumin D. Remote Heart Rate Estimation Based on Transformer with Multi-Skip Connection Decoder: Method and Evaluation in the Wild // Sensors. 2024. vol. 24. pp. 775.
Dvoynikova A., Kagirov I., Karpov A. A Method for Recognition of Sentiment and Emotions in Russian Speech Transcripts Using Machine Translation // Informatics and Automation. 2024. vol. 23. no. 4. pp. 1173-1198.
More
Povolotskaia A., Karpov A. Analytical Review of Methods for Automatic Analysis of Extra-Linguistic Units in Spontaneous Speech // Informatics and Automation. 2024. vol. 23. no. 1. pp. 5-38.
More
Ivanko D.V., Ryumin D.A. Automatic sign language translation: a review of neural network methods for recognition and synthesis of spoken and signed language // Scientific and Technical Journal of Information Technologies, Mechanics and Optics. 2024. vol. 24. no. 5. pp. 669–686.
Uzdiaev M. Yu., Karpov A. A. Creation and analysis of multimodal corpus for aggressive behavior recognition // Scientific and Technical Journal of Information Technologies, Mechanics and Optics. 2024. vol. 24. no. 5. pp. 834-842.
More
Velichko A., Karpov A. An approach for depression recognition by speech using a semi-automatic data annotation // Information and Control Systems. 2024. no. 4. pp. 2-11.
More
Kapusta K., Kipyatkova I., Kagirov I. Analytical survey of transformer-based end-to-end speech recognition models and strategies // Information and Control Systems. 2024. no. 5. pp. 2-15.
More
Bubeev Yu.A., Syrkin L.D., Polyakov A.V., Usov V.M., Karpov A.A., Ivanov A.V. Practice of teleconsultation for evaluation of personal adaptation potential and detection of indications for providing qualified psychological services to employees in remote regions of Russia // Aerospace and Environmental Medicine (Aviakosmicheskaya i Ekologicheskaya Meditsina). 2024. vol. 58. pp. 5-16.
Axyonov A., Ryumin D., Ivanko D., Kashevnik A., Karpov A. Audio-Visual Speech Recognition In-The-Wild: Multi-Angle Vehicle Cabin Dataset and Attention-Based Approach // In Proc. of IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP). 2024. pp. 8195-8199.
Ryumina E., Ryumin D., Karpov A. OCEAN-AI: Open Multimodal Framework for Personality Traits Assessment and HR-processes Automatization // In Proc. of INTERSPEECH. 2024. pp. 3630-3631.
Ivanko D., Ryumin D., Axyonov A., Kashevnik A., Karpov A. OpenAV: Bilingual Dataset for Audio-Visual Voice Control of a Computer for Hand Disabled People // Lecture Notes in Computer Science, SPECOM-2024. 2024. vol. 15299. pp. 163-173.