Dissertation > Excellent graduate degree dissertation topics show

Feature Extraction, Selection and Combination in Lipreading

Author: ZhangShengPing
Tutor: YaoHongXun
School: Harbin Institute of Technology
Course: Computer Science and Technology
Keywords: lip-reading feature extraction feature selection feature fusion Gabor wavelet transform AdaBoost manifold learning
CLC: TP391.41
Type: Master's thesis
Year: 2008
Downloads: 125
Quote: 3
Read: Download Dissertation


Lipreading is the technology that uses computer to recognize the lip motion se-quence. It involves pattern recognition, artificial intelligence, image processing, andso on. This paper mainly focuses on the feature extraction, selection and combinationunder the single-visual channel and the main work includes:1. In feature extraction, this paper analyzes the applications of manifold learningin lipreading. Manifold learning is a nonlinear feature extraction method. In order toeffectively extract the intrinsical feature of lip motion, this paper analyzes the applica-tion of two manifold learning methods (LLE and Isomap) in lipreading. The ordinaryLLE and Isomap can not effectively get the embedding of new sample. A novel ker-nel based LLE and Isomap method is proposed. Experimental results show althoughthe proposed method can not get better recognition performance than traditional lin-ear methods, it can extract the intrinsical features of lip motion more effectively thantraditional methods.2. In feature selection, this paper present an optimal Gabor kernels selectionmethod based on AdaBoost. Gabor transform gets many attention because of its goodrecognition performance in pattern recognition field. However, the feature dimension-ality extracted by Gabor is extremely high, which results in needing a huge numberof training samples and restricting the applications of lipreading technology in realworld. In consideration of the appearance symmetry of mouth region and the direc-tion of Gabor kernel functions, this paper presents an optimal Gabor kernels selectionmethod based on AdaBoost. The proposed method first divides the entire mouth re-gion into four sub-blocks, then adaptively select optimal Gabor kernels function forevery sub-block based on AdaBoost. Experimental results validates that the selectedGabor kernels have the same direction with the appearance of mouth region. The di-mensionality of resulting feature vector was significantly reduced. The recognitionperformance is superior to traditional methods.3. In feature combination, this paper presents a novel classifier level combina-tion method which combines the global and local feature. In literature, a large numberof pixel-based feature extraction methods were proposed. Traditional feature extrac- tion methods exploit only global or local features. However, Some psychologicalevidences show that people use both global and local features for object recognition,in some extent, people use global features before analyzing the image in detail. Mo-tivated by this study, this paper presents a novel classifier combination method whichcombines the global and local feature. The global classifier uses Discrete FourierTransform (DFT) to extract global features and the local classifier uses block-basedGabor wavelets transform to extract local features. The final classifier combines theoutputs of both global and local classifiers. Experimental results show that the com-bined classifier gives distinctly superior recognition rate than each of the individualclassifiers.

Related Dissertations

  1. The Classification of High Dimsnsion Flew Field Based on Manifold Learning,V231.3
  2. Research on Automatic Detection Algorithm for Substructure Distress of Highway Pavement Based on SVM,U418.6
  3. ISAR Imaging Simulation of Space Targets and Target Recognition Based on ISAR Images,TN957.52
  4. Research on the Classification Based on the Reconstruction of Solder Joint,TP391.41
  5. Tongue Feature Extraction and Research of Fusion Classification,TP391.41
  6. The Fatigue State Recognition of the Driver Based on Eye Detection,TP391.41
  7. Research on Feature Extraction and Classification of Pulse Waveform for Cholecystitis and Nephrotic Syndrome Diagnosis,TP391.41
  8. Application of Q-Learning in the Content-Based Image Retrieval Technology,TP391.41
  9. Research on Transductive Support Vector Machine and Its Application in Image Retrieval,TP391.41
  10. Research on Feature Extraction and Classification of Tongue Shape and Tooth-Marked Tongue in TCM Tongue Diagnosis,TP391.41
  11. Research on Text Classification Based on Biomimetic Pattern Recongnition,TP391.1
  12. Research on Visual Measurement for Spacecraft Rendezvous and Approach,TP391.41
  13. Research on the Image Real-Time Acquisition, Storage and Image Processing System,TP391.41
  14. Multi-currency Notes Technology Research and Implementation,TP391.41
  15. The Research on Paper Currency Classification Method Based on Harr-Like Feature and Minimal Ball Including Samples,TP391.41
  16. Pavement Distress Recognition Based on Image,TP391.41
  17. Research on Visual Detection and Tracking of Mobile Robots,TP242.62
  18. Research on Fusion Algorithm of Hyper Spectral and High Spatial Resolution Remote Sensing Image,TP751
  19. Tobacco Diseases Auto-Recognition Research Based on Image Processing Technology,S435.72
  20. Research on Nondestructive Detection Technology for External Qualities of Papayas Based-on Vision,S667.9

CLC: > Industrial Technology > Automation technology,computer technology > Computing technology,computer technology > Computer applications > Information processing (information processing) > Pattern Recognition and devices > Image recognition device
© 2012 www.DissertationTopic.Net  Mobile