Keio University

Challenge Grant: Development of an Alternative Communication Tool Using Lipreading Techniques for Laryngectomy Patients

Publish: June 30, 2025
KGRI

Integration

Summary

This study aims to develop a device that uses lip-reading techniques to convert video of the mouth into language, which is then converted into voice using AI synthesis. Many patients still lose their ability to speak due to treatments for laryngeal cancer and other conditions. Conventional substitute voices still have issues with clarity and sustainability. The device we are developing will solve these issues and reproduce the patient's original voice. This research will contribute to improving the quality of life for patients who have lost their ability to speak.

Project Members

Note: ◎ indicates the project leader

Project Members

Principal Investigator

Shuta Tomisato

InstructorSchool of MedicineOtolaryngology, Speech-Language Pathology

Yasue Mitsukura

ProfessorFaculty of Science and TechnologyIntelligent informatics, Kansei informatics, Electron device/Electronic equipment

Hiroyuki Ozawa

ProfessorSchool of MedicineOtorhinolaryngology