Dissertation > Excellent graduate degree dissertation topics show

Research of Manifold Learning in Data Dimension Reduction and Classification

Author: LiuXiaoMing
Tutor: DongJinXiang;YinJianWei
School: Zhejiang University
Course: Computer Science and Technology
Keywords: manifold learning linear dimension reduction nonlinear dimension reduction local tangent space transductive classification covariance preserving locality sensitive discriminant analysis matrix representation LDA/QR
CLC: TP311.13
Type: PhD thesis
Year: 2007
Downloads: 2364
Quote: 11
Read: Download Dissertation

Abstract


With the quick advancement and extensive application of information technology, more data with high dimension and complex structure occurs very quickly. High dimension not only makes the data hard to understand, and makes traditional machine learning and data mining techniques less effective. Dimension reduction is one of the important techniques to deal with high-dimensional data; while there have been many research work done in this field, there are still challenging problems to uncover the linear and nonlinear structure information in data. In 2000, three articles published on Science magazine studied the dimension reduction issue from the perspectives of neuroscience and computer science respectively, which further accelerate the research of this field, and promote the manifold learning methods for dimension reduction become one of the hot problems in machine learning.This dissertation deals with manifold learning for dimension reduction and its application, studies the problem from the both the linear and nonlinear, unsupervised and supervised perspectives. The main contributions of this dissertation can be summarized as follows:In the perspective of supervised global linear dimension reduction, a Pairwise Covariance-preserving Projection Method (PCPM) is proposed, which maximizes the class mean distance and also preserves approximately the distance of pairwise class covariances. The optimization involved in PCPM can be solved directly by eigenvalues decomposition. Theoretical analysis reveals the relationship between PCPM and Linear Discriminant Analysis (LDA), Sliced Average Variance Estimator (SAVE), Heteroscedastic Discriminant Analysis (HDA) and Covariance-preserving Projection Method (CPM). Furthermore, pairwise weights related to Bayes classification accuracy are incorporated naturally with the pairwise summarization form, and a weighted PCPM is also proposed.In the perspective of unsupervised nonlinear dimension reduction, an incremental version ILTSA of LTSA (Local Tangent Space Alignment) is proposed, which can greatly reduce the computation time demand of LTSA algorithm to deal with new data. For a new sample data, the low-dimensional affine subspaces of affected points are updated firstly. Through minimizing the reconstruction errors of data point as respect to existing points, the global coordinates and local alignment matrix of existing points are obtained and the global coordinate of new data point is obtained in the least square sense. Finally, the global coordinates of all data points are updated with Rayleigh-Ritzacceleration. Besides, a landmark version of LTSA (LLTSA) is proposed, where landmarks are selected based on LASSO regression, which can reduce the memory demand of the algorithm. Furthermore, an incremental version (ILLTSA) of LLTSA is also proposed.In the perspective of supervised nonlinear dimension reduction, a new transductive classification method based on local tangent space alignment (LTSA) and transductive k-nearest neighbors is proposed. In the method, an improved 2-stage LDA/QR method is used to construct local low-dimensional coordinates, which can not only utilize the label information of sample data, but can also conquer the singularity problem of traditional LDA. Then the global low-dimensional embedding coordinates are obtained with LTSA, and TCM-KNN method is used for classification on the low-dimensional manifold finally.In the perspective of linear approximation of nonlinear dimension reduction, an Orthogonal Neighborhood Preserving Embedding method is proposed to overcome the sensitivity of dimension estimation problem of Neighborhood Preserving Embedding method. The method obtains the low dimensional coordinates by iteratively computes the mutually orthogonal basis functions, can assure the orthogonality of the projection matrix. Moreover, utilizing the local geometry during ONPE dimension reduction, a new classification method based on label propagation method (LNP) is proposed.In the perspective of supervised linear dimension reduction with matrix representation, a method called two-dimensional locality sensitive discriminant analysis (2DLSDA) for image recognition is proposed, which is based directly on 2D image matrices, can overcome the singularity problem and can utilize the spatial information among pixels more effectively. Two orthogonal transform matrixes are computed based on Schur decomposition. Based on Schur decomposition, the projection matrixes are orthogonal and can be obtained more efficient and numerical stable. Meanwhile, based on the unfolding way of image matrices, two unilateral 2DLSDA methods are proposed.

Related Dissertations

  1. The Classification of High Dimsnsion Flew Field Based on Manifold Learning,V231.3
  2. Feature Extraction, Selection and Combination in Lipreading,TP391.41
  3. Study of Data Reduction Technique Based on Manifold Learning,TP311.13
  4. Research on Learning-Based Super-Resolution and SR System Implementation,TP391.41
  5. EEG -based emotion recognition,TP391.4
  6. Time series visualization of human motion and multi- index method,TP391.41
  7. Based on multi- location basis ISOMAP Algorithm Research,TP181
  8. Detection of Hailstone in the Rainstorm,P429
  9. The quaternion M ( ? ) Bius transform classification and dimensional Clifford algebra equation,O151.21
  10. Incremental Spectral Embedding Methods in Manifold Learning,TP181
  11. Research on Key Technology of LTE Intrusion Detection Systems,TP393.08
  12. Preliminary Study on Law Dimension and Visualization of Nonlinear System,TP391.41
  13. Facial expression recognition research based on manifold learning,TP391.41
  14. Research on Image Representation Methods in Face Recognition,TP391.41
  15. Discussion supervised manifold learning algorithm,O186.12
  16. Robust manifold learning algorithm and its application,TP181
  17. Study of Applying Manifold Learning to Road Icon Identification,TP391.41
  18. Research on Manifold Learning Algorithms and the Applications in Image Recognition,TP391.41
  19. Reseach on Nonlinear Dimensionality Reduction Methods in Manifold Learning and Their Applications for Tobacco Data,TP181
  20. The robustness Research manifold learning,TP181
  21. Research on Mobile Nodes Localization Algorithm in WSNs,TN929.5

CLC: > Industrial Technology > Automation technology,computer technology > Computing technology,computer technology > Computer software > Program design,software engineering > Programming > Database theory and systems
© 2012 www.DissertationTopic.Net  Mobile