Speech and Multimodal Interfaces Laboratory

Publications

2021

Dresvyanskiy D., Siegert I., Karpov A., Minker W. Engagement Recognition Using Audio Channel Only // In Proc. 1st AI-Debate Workshop: establishing An InterDisciplinary pErspective on speech-based Technology. Magdeburg, Germany. 2021. pp. 19-22.

Kashevnik A., Lashkov I., Axyonov A., Ivanko D., Ryumin D., Kolchin A., Karpov A. Multimodal Corpus Design for Audio-Visual Speech Recognition in Vehicle Cabin // IEEE Access, IEEE Press. 2021. Vol. 9. pp. 34986-35003.

Kagirov I., Kapustin A., Kipyatkova I., Klyuzhev K., Kudryavcev A., Kudryavcev I., Loskutov Y., Ryumin D., Karpov A. Medical exoskeleton “Remotion” with an intelligent control system: Modeling, implementation, and testing // Simulation Modelling Practice and Theory. Elsevier. 2021. Vol. 107. ID 102200.

Dvoynikova A., Markitantov M, Ryumina E., Ryumin D., Karpov A. Analytical Review of Audiovisual Systems for Determining Personal Protective Equipment on a Person's Face // Informatics and Automation. 2021. No 20(5). pp. 1115-1152.

Velichko A., Karpov A. Analytical Review of Automatic Systems for Depression Detection by Speech // Informatics and Automation. 2021. No 20(3). pp. 497-529.

Ryumin D.A., Kagirov I.A., Axyonov A.А., Karpov A.A. Analytical Review of Models and Methods for Automatic Recognition of Gestures and Sign Languages // Informatsionno-Upravliaiushchie Sistemy. 2021. Vol. 6. pp. 10-20.

Ryumina E., Verkholyak O., Karpov A. Annotation Confidence vs. Training Sample Size: Trade-Off Solution for Partially-Continuous Categorical Emotion Recognition // In Proc. International Conference INTERSPEECH-2021. Brno, Czechia. 2021. pp. 3690-3694.

Ivanko D., Ryumin D., Axyonov A., Kashevnik A. Speaker-Dependent Visual Command Recognition in Vehicle Cabin: Methodology and Evaluation // In Proc. SPECOM 2021. Lecture Notes in Computer Science, Springer. Vol. 12997. 2021. pp. 291-302.

Kipyatkova I. End-to-End Russian Speech Recognition Models with Multi-head Attention // In Proc. SPECOM 2021. Lecture Notes in Computer Science, Springer. Vol. 12997. 2021. pp. 327-335.

Karpov A., Potapova R. SPECOM 2021 Preface // Lecture Notes in Computer Science, Springer, Vol. 12997. Proc. 23rd International Conference on Speech and Computer SPECOM 2021. 2021.

Ryumina E., Ryumin D., Ivanko D., Karpov A. A novel method for protective face mask detection using convolutional neural networks and image histograms // The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences. Moscow. 2021. Vol. XLIV-2/W1-2021. pp. 177–182.

Ivanko D., Ryumin D. A novel task-oriented approach toward automated lip-reading system implementation // The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences. Moscow. 2021. Vol. XLIV-2/W1-2021. pp. 85-89.

Axyonov А., Ryumin D., Kagirov I. Method of multi-modal video analysis of hand movements for automatic recognition of isolated signs of Russian sign language // The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences. Moscow. 2021. Vol. XLIV-2/W1-2021. pp. 7–13.

Ivanko D., Ryumin D., Karpov A. Developing of a Software-Hardware Complex for Automatic Audio-Visual Speech Recognition in Human–Robot Interfaces // Smart Innovation, Systems and Technologies, Springer, Electromechanics and Robotics ZR-2021. 2021. Vol. 232. pp. 259-270.

Letenkov M., Iakovlev R., Karpov. A. Approach to Image-based Face Recognition in Setting of Partial Face Occlusion by Personal Protective Equipment // Smart Innovation, Systems and Technologies, Springer, Electromechanics and Robotics ZR-2021. 2021. Vol. 232. pp. 249-258.