Dissertation > Excellent graduate degree dissertation topics show

Research on Chinese Spelling Correction in Question and Answer System

Author: QinYing
Tutor: MaZuo
School: Shandong University
Course: Control Science and Engineering
Keywords: Question and answer system statistical language model Spelling correction Decoding Algorithm
CLC: TP391.1
Type: Master's thesis
Year: 2012
Downloads: 55
Quote: 0
Read: Download Dissertation

Abstract


The Question and Answer system for the Internet has played a more and more important role as in the development of Web. For the number of search engine users are growing quickly, and together with the requirements for Question and Answer system are higher and higher, its functions continuously improved. The spelling checking and correcting function is a very important additional technology.In the Chinese search engine, the definition of spelling auto-checking and correcting function is that when a user input a question which is not in the QA database, it will return a similar question as the suggest.Finally the user will see the suggest question in the QA system page.In terms of the characteristics of Chinese language, an N-gram statistical language model has been set up. The model is also analyzed detailed to determine the necessary parameters. On this basis, the language model will be optimized and closer to real language. A pinyin correction and mapping table combine is introduced to the field of Chinese spelling correction in QA system. The language model decoding algorithm to optimize the correction results is firstly introduced.All the theoretical models proposed in this paper were all verified based on platform. On the statistical language model basis, it verified by three experiment. One is only has Pinyin correction, second is Pinyin and mapping table combine, last is on the second basis, use language model decoding algorithm to optimize the results.Finaly,it verified that the models can achieve good results by the last experiment,and the more contextual information,the higher error correction recall and precision.Finally, conclusions are given with recommendation for future work.

Related Dissertations

  1. The Research of Decoding Algorithm for Statistical Machine Tranlation,TP391.2
  2. Kullback-Leibler distance framework abstracts retrieved in Retrieval,TP391.3
  3. Research and Implementation of Convertion for Mongolian Presentation Character to Basic Letter,TP391.1
  4. Chinese-Mongolian Statistical Machine Translation System Based on Affix Features,TP391.2
  5. Research of Question Answering System Based on Mobile Technology,TP311.52
  6. A Back-off Smoothing Algorithm of Language Model Based on Mutual Information,TP391.1
  7. Research and Design of Intelligence Question and Answer Based on Mobile Learning,TP311.52
  8. Research on Context Sensitive Personalized Information Retrieval Technology,TP391.3
  9. Application Research on Statistical Language Model of Large Vocabulary Continuous Speech Recognition System,TP391.42
  10. Research on the Methods of Chinese Text Classification Using Bayes and Language Model,TP391.1
  11. The Research on Constructing Layered Mongolian Laguage Model,TP391.1
  12. Researching of Long-Distance Mongolia Language Model Based on Trigger Pair,TP391.42
  13. Research on Information Retrieval Models Based on Statistical Language Model and Passage Feature,TP391.3
  14. Research of the Mixed Language Model Based on Statistical and Latent Semantic Analysis,TP391.1
  15. Design and Implementation of Automatical Recognition of Chinese Personal Name,TP391.1
  16. Study of Application of a Language Model Combining Statistics and Rules in Chinese Input Method,TP391.14
  17. Statistical Language Models Based Chinese Text Information Retrieval,G354
  18. Study on Chinese Named Entity Recognition,TP391.4
  19. The Smoothing Technique Based on Mutual Information for Statistical Language Model,TP391.1
  20. Research and Implementation of Chinese Auto-segmentation System,TP391.1
  21. Research and Improvement on Na(?)ve Bayes Test Classifier,TP391.1

CLC: > Industrial Technology > Automation technology,computer technology > Computing technology,computer technology > Computer applications > Information processing (information processing) > Text Processing
© 2012 www.DissertationTopic.Net  Mobile