Dissertation > Excellent graduate degree dissertation topics show

Latent Semantic Analysis Based on Multi-system Combination

Author: ChangLiWei
Tutor: CaiDongFeng
School:
Course: Pattern Recognition and Intelligent Systems
Keywords: Latent Semantic Analysis Subspace Optimization System Combination Augmented Space Model Text Categorization
CLC: TP391.1
Type: Master's thesis
Year: 2013
Downloads: 27
Quote: 0
Read: Download Dissertation

Abstract


Latent Semantic Analysis is a technology of data mining based on statistic, which iswidely applied in the task of text categorization of Information Retrieval. The kernel model ofthe technology is an optimization model of Vector Space Model. Through extracting theinformation of potential semantic structure, a new space with some new abstract semanticdimensions formed by the information will be constructed. Based on the above description,the assumption of feature independence is broken, and a text can be described by lessdimensions.Many studies show that the performance of data mining system based on statistic can beimproved effectively through increasing the scale of training data. However, after addingsaturated information to training data, the strategy will not work well. At the same time, muchnoise and redundant information will be brought into the model. On the one hand theperformance of the model we construct on the training data will be restrained, and on theother hand the model we get will be too big. So the focus of this paper is the optimization andcombination of multi-model.Through researching the features and the applications of two technologies of subspaceoptimization and system combination, a new concept, which is named Augmented SpaceModel, is proposed based on a lot of experiments and error analysis. The Augmented SpaceModel combines two Latent Semantic Analysis models’ most important dimensions, so thattwo Latent Semantic Analysis models can learn knowledge from each other, then the LatentSemantic Analysis will be optimized effectively. Besides, the strategy of data segmentation isalso researched to get a new method which is named as Data Segmentation Strategy based onthe lengths of documents and DF Distribution. The strategy can ensure that the informationdistribution is damaged as slightly as possible. At the same time because the scale of thesubspace is much smaller than the original space, the noise information brought by redundantinformation is reduced. Based on the researches of the optimization of the Latent Semantic Analysis,multi-strategy and multi-system combination has been applied to construct a textclassification system. Experimental results show that the final classification precision wasabout3percent higher after multi-strategy and multilevel system combination than that of thebest baseline model.

Related Dissertations

  1. Research on Topic Clustering Model of Socail Tagging Based on Bayesian Theory,C93
  2. A Study of Based on LSA and Paragraph Clustering of Automatic Abstracting System,TP391.1
  3. Research on Several Models in Text Classification and Clustering,TP391.1
  4. Research on Management Effectivness of Military Professional and Technical Human Resources,E263
  5. Research Key Issues of Analysis of Inquiry Questions on Chinese Q&A System,TP391.1
  6. The Intelligent Search Technology Based on Latent Semantic Analysis,TP391.3
  7. Key Techniques of Text Mining’s Research and Application on Electronic Employment,TP391.1
  8. PLSA Model Based Detection of Porn Pictures,TP391.41
  9. Study on Chinese Text Categorization,TP391.1
  10. Internet News Hot Mining System Research and Implementation,TP393.09
  11. Network Public Opinion Early Warning Assisted Decision Support System Model and Key Technology Research,TP393.09
  12. Content-based spam filtering technology research,TP393.098
  13. Chinese named entity recognition and disambiguation of,TP391.1
  14. The Implementation and Research of the Probabilistic Latent Semantic Analysis Model in the Search Engine’s Business Text Classification System,TP391.1
  15. Network public opinion analysis to key technology research and,TP393.09
  16. Service Based Weapon System-of-Systems Architectural Modeling and Analysis,E920
  17. Text Categorization Based on Rough Set Theory,TP18
  18. Research on the Comprehensive Risk Assessment of Chinese Commercail Banks,F832.2
  19. The Research of an Automatic Recommended Model of Reviewer for a Submission System,TP182
  20. The Performance Optimization Research on Large Vocabulary Continuous Speech Recognition,TP391.42
  21. The ancient cases data mining technology research,TP311.13

CLC: > Industrial Technology > Automation technology,computer technology > Computing technology,computer technology > Computer applications > Information processing (information processing) > Text Processing
© 2012 www.DissertationTopic.Net  Mobile