An Extraction Method of Lip Movement Images from Successive Image Frames in the Speech Activity Extraction Process

Abstract : In this paper, we propose an extraction method of lip movement images from successive image frames and present the possibility to utilize lip movement images in the speech activity extraction process of speech recognition phase. The image frames are acquired from the PC image camera with the assumption that facial movement is limited during talking. First of all, one new lip movement image frame is generated with comparing two successive image frames each other. Second, the fine image noises are removed. Each fitness rate is calculated by comparing the lip feature data as objectly separated images. It is analyzed whether or not there is the lip movement image through verification to the objects and three images which have higher rates in their fitnesses. As a result of linking the speech & image processing system, the interworking rate shows 99.3% even in the various illumination environments. It was visually confirmed that lip movement images are tracked and can be utilized in speech activity extraction process.
Document type :
Conference papers
Complete list of metadatas

Cited literature [6 references]  Display  Hide  Download

https://hal.inria.fr/hal-01055628
Contributor : Hal Ifip <>
Submitted on : Wednesday, August 13, 2014 - 1:50:50 PM
Last modification on : Wednesday, August 21, 2019 - 2:46:16 PM
Long-term archiving on : Thursday, November 27, 2014 - 12:02:08 AM

File

icec2010_submission_11.pdf
Files produced by the author(s)

Licence


Distributed under a Creative Commons Attribution 4.0 International License

Identifiers

Citation

Eung-Kyeu Kim, Soo-Jong Lee, Nohpill Park. An Extraction Method of Lip Movement Images from Successive Image Frames in the Speech Activity Extraction Process. 9th International Conference on Entertainment Computing (ICEC), Sep 2010, Seoul, South Korea. pp.317-325, ⟨10.1007/978-3-642-15399-0_33⟩. ⟨hal-01055628⟩

Share

Metrics

Record views

103

Files downloads

674