Dissertation > Excellent graduate degree dissertation topics show

Researches on Lip Reading Using the Color and Depth Image

Author: SunWei
Tutor: LiLei
School: University of Electronic Science and Technology
Course: Signal and Information Processing
Keywords: Lip-reading Color and Depth Images SVM Classification DeformableTemplate Lip region location
CLC: TP391.41
Type: Master's thesis
Year: 2013
Downloads: 19
Quote: 0
Read: Download Dissertation

Abstract


Lip-reading technology is a new interdisciplinary research area, covering severalkey technologies of image processing, pattern recognition and computer vision. With itsvisual advantages, it is widely used in assistant rehabilitation of the deaf, assistant voicerecognition, gesture recognition, and personal identity authentication and so on. Basedon the summary of present research results home and abroad, the key modules on lipreading techniques are intensive studied in this project. The major works are listed asfollows:(1)The small colored and depth image database is constructed because of the factthat corresponding database between color picture and depth image is needed due to theparticularity of research direction of this project, however, at present there is no such amature database, and the preliminary video segmentation is completed and key frameimages are achieved.(2) The related research of location of lip region is conducted. The preciselocalization with the aid of the method of zone location of lip based on the facedetection and relative structure of facial features is carried on and through the massiveexperiments, the optimum parameter of lip in the face region distribution, comparedwith that of nose, is proposed. The experiment result indicated that the parameter whichthis project has put forward can demarcate the lip region precisely and eliminate otherdisturbances as far as possible.(3) In terms of lip division technology research, using the color and depth imagelip division methods are presented in the project. Regarding the color image, thesuggestion that better division threshold value using the Otsu method could be obtainedin the research of threshold value choice is raised based on the lip extraction methodusing a-plane in Lab color space. Regarding the depth image, lip region of depth imageis obtained through mapping of the color image and the division of the depth image lipzone using the K-means cluster is adopted. The research of union and denoisingmethods of these two images is conducted. The experiment proves that the lip and the non-lip picture elements could be separated precisely and effectively with the help ofthe lip division method of color and depth image.(4) In terms of lip feature extraction, the feature extraction method based on theprojection and the deformable template is utilized. Firstly, the initialization spot of thedeformable template is found precisely using the projection, and then makes thedeformable template iterate nearby the initialization spot, which reduces the iterativetimes massively and enhances the matching speed of invariable template. Moreover, interms of recognition method, the classified experiment using the SVM classificationmethod is carried on, which indicates that the method adopted in the thesis couldenhance the recognition rate of the lip-reading system.

Related Dissertations

  1. Feature Extraction, Selection and Combination in Lipreading,TP391.41
  2. Study on Fingerprint Image Quality Assessment Based on SVM Classification,TP391.41
  3. Lip Feature Extraction and Recognition with Head-camera,TP391.41
  4. The Research and Implementation of Algorithms of License Plate Localization and Character Segmentation,TP391.41
  5. Research and Realization of Lip-reading Recognition System,TP391.41
  6. The Classification of DNA Sequence Based on Support Vector Machine,TP18
  7. Research on Power Quality Disturbance Based on Improved S-Transform,TM711
  8. The Election, Alignment and Fusion Based on Static-Dynamic Multisource Features in Lipreading,TP391.41
  9. Stock Selection Based on Multi-Class SVMs,F224
  10. Study on Fake Website Monitoring and Management Technology,TP393.08
  11. The Study of SVM-based fMRI Data Classification on MCI,TP311.13
  12. Research on Dimensional Reduction and Classificasstion Method of Hyperspectral Remote Sensing Images,P237
  13. On the Statistical Model for Sign Language Understanding,TP391.4
  14. Research on Text Detection in Images and Video Frames,TP391.4
  15. Experimental Study on Lipreading Chinese Phonetic Identification for the Hearing Handicapped,G762
  16. Research on Lipreading System Based on Visual Channal Only,TP391.41
  17. Research on Speech and Lipreading Human-Machine Interaction for Service Robot,TP242.3
  18. Research on Method of Off-line Handwritten Chinese Characters Recognizing Based on Binary Tree SVM,TP391.41
  19. Lip Detecting Algorithm Research and Hardware Implementation,TP391.41
  20. Lipreading Technology Based on Lip Motion Feature,TP391.41

CLC: > Industrial Technology > Automation technology,computer technology > Computing technology,computer technology > Computer applications > Information processing (information processing) > Pattern Recognition and devices > Image recognition device
© 2012 www.DissertationTopic.Net  Mobile