Speech and Multimodal Interfaces Laboratory

Ryumin Dmitry Alexandrovich

Ryumin Dmitry Alexandrovich
Position
Senior researcher
Qualification
PhD

Publications

2024

Othman W., Kashevnik A., Ali A., Shilov N., Ryumin D. Remote Heart Rate Estimation Based on Transformer with Multi-Skip Connection Decoder: Method and Evaluation in the Wild // Sensors. 2024. vol. 24. pp. 775.
Ivanko D.V., Ryumin D.A. Automatic sign language translation: a review of neural network methods for recognition and synthesis of spoken and signed language // Scientific and Technical Journal of Information Technologies, Mechanics and Optics. 2024. vol. 24. no. 5. pp. 669–686.
Axyonov A., Ryumin D., Ivanko D., Kashevnik A., Karpov A. Audio-Visual Speech Recognition In-The-Wild: Multi-Angle Vehicle Cabin Dataset and Attention-Based Approach // In Proc. of IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP). 2024. pp. 8195-8199.
Ryumina E., Ryumin D., Karpov A. OCEAN-AI: Open Multimodal Framework for Personality Traits Assessment and HR-processes Automatization // In Proc. of INTERSPEECH. 2024. pp. 3630-3631.
Ivanko D., Ryumin D., Axyonov A., Kashevnik A., Karpov A. OpenAV: Bilingual Dataset for Audio-Visual Voice Control of a Computer for Hand Disabled People // Lecture Notes in Computer Science, SPECOM-2024. 2024. vol. 15299. pp. 163-173.
Ivanko D., Ryumin D., Markitantov M. End-to-End Visual Speech Recognition for Human-Robot Interaction // In Proc. of the AIP Conference. 2024. vol. 3021. pp. 82-90.

2023

Ryumina E., Ryumin D., Markitantov M., Kaya H., Karpov A. Multimodal Personality Traits Assessment (MuPTA) Corpus: The Impact of Spontaneous and Read Speech// In Proc. of the 24th International Conference INTERSPEECH-2023. 2023. pp. 4049–4053.