Speech and Multimodal Interfaces Laboratory

Scientific press tour with the participation of federal TV channels in SPC RAS

The researchers presented a prototype of a system that can recognize human speech by lips, and also demonstrated the possibility of practical application of the system. The program was created by employees of several laboratories of the St. Petersburg Federal Research Center of the Russian Academy of Sciences (SPC RAS).

During the event, Denis Ivanko, senior researcher at the Speech and Multimodal Interfaces Laboratory, launched a prototype of a speech recognition system on a personal computer. He demonstrated to journalists the operation of the program, which successfully recognized several simple commands.

Then Alexey Karpov, head of the Speech and Multimodal Interfaces Laboratory, spoke in general about the projects that are currently being carried out in his scientific field.

After that, Alexey Kashevnik, a senior researcher at the Integrated Automation Systems Laboratory, demonstrated one of the options for the practical application of a system for lip-speech recognition: as part of a smartphone application that monitors the dangerous states of a car driver.

Film crews of NTV, Rossiya 1 and 78.ru TV channels took part in the press tour.

Learn more about developing a lip-speech recognition system.

Links to TV episodes: