Dissertation > Excellent graduate degree dissertation topics show

Chinese word segmentation based on understanding of system design and implementation

Author: SuYong
Tutor: FuYan；YuBin
School: University of Electronic Science and Technology
Course: Software Engineering
Keywords: Chinese word Segmentation word Segmentation Semantic-based word Segmentation ambiguity string
CLC: TP391.1
Type: Master's thesis
Year: 2011
Downloads: 77
Quote: 0
Read: Download Dissertation

Abstract


In today’s popularity of the Internet era, we face the lack of information and is no longer a question of access to information, but information on how the face of the proliferation of mass screening, processing problems. Most of these Internet information is semi-structured text or plain text form, and so naturally produce the text of the strong demand for mining information.Intelligent Processing of Chinese first condition is to realize the Chinese word processing. Chinese word segmentation problem stems from its unique language and culture different from Chinese and Western text no significant between words separated by markers. Thus was born the Chinese word technology, the research goal is to solve the Chinese text into words in a string into a combination of problems, a computer-based intelligent information processing Chinese language procedure. From the 1980s to now, Chinese word segmentation after decades of research and development has made some achievements, but dealing with ambiguity and unknown words in the handling is still not yet effective solution.Chinese word segmentation can be summarized into three: First, based on string matching word; two, based on statistical probability of word; Third, based on understanding of the word. Three kinds of segmentation methods have advantages and disadvantages, which the first and second sub-word models have been developed relatively mature and stable, and developed a lot of very good algorithm, the third sub-word model is still in its infancy is the most potential the sub-word method. Three kinds of sub-word models as used in the different technical principles and models which have their own shortcomings and deficiencies, but it has three modes have complementary functions.The main objective of this study is to solve the ambiguity problem, especially pseudo-ambiguous solution to the problem. Article discusses the causes of ambiguity, ambiguous definitions, and the causes for the ambiguity ambiguity solution is given in an attempt to build a resolve to achieve the pseudo-ambiguous Chinese word segmentation system. Meanwhile, the article also discusses the solution to unknown word, for there is a pattern of the unknown word identification program using the model to deal with.This article focuses on the ambiguity of the solution design, implementation, and focuses on the semantic information such as how to use formal models and semantics, knowledge and other information word. This paper introduces the dictionary matching, pattern processing, semantic integration of word verification system model and the overall design of data representation and storage implementation, and operation of the system involved in the algorithm gives a detailed introduction. On this basis, this database using C # language and development platform such as design models and programs for system development and implementation.Finally, the article summarizes the experiences and achievements of the program also pointed out the deficiencies and areas for improvement and development of the system next target..

Related Dissertations

  1. Research and Development of Digital Resources Search Engine Technologies on Campus Network,TP391.3
  2. Research on Vertical Search Engine Based on SSH and Lucene,TP391.3
  3. Search engine for the field of art education applications,J20-4
  4. Text classification based anti-spam technology,TP393.098
  5. Research and Implement of Chinese Word Segment Techniques Based on the Conditional Random Field,TP391.1
  6. Different syntax level of knowledge on Chinese word segmentation,B842
  7. The Study of College Digital Campus Web Information Filtering,TP393.09
  8. The Study of Chinese Word Segmentation on Uygur Students’and Han Students’ Eye Movement,B842.3
  9. The Effect of Word Segmentation on Chinese Text Reading: Evidence from Korean Students and Thai Students’ Eye Movements,B842.3
  10. A Research and Implementation of Chinese Word Segmentation Based on Machine Learning,TP391.1
  11. University BBS Retrieval System Design and Implementation,TP393.094
  12. Researching into Audit of SMS Content Base on Cloud Computing,TP3
  13. A Text Categorization Method Based on Features Clustering,TP391.1
  14. Study on the Key Technology of Tibetan Speech Synthesis,H214
  15. Design a Enterprise Information Search Engine and Research Its Key Technology,TP391.3
  16. Study and Implementation on Chinese Word Segmentation Algorithm of Search Engine Based on Nutch,TP391.1
  17. Word segmentation Chinese reading for Russian students,H195
  18. Development of Street Video Monitor System for Xuhui Public Security Bureau Based on GIS,P208
  19. Research and Application of Internet Chinese Text Classification,TP391.1
  20. One kind of Chinese unknown word recognition and new design method dictionary,TP391.1
  21. The Design and Implementation of the Search Engine System,TP391.3

CLC: > Industrial Technology > Automation technology,computer technology > Computing technology,computer technology > Computer applications > Information processing (information processing) > Text Processing
© 2012 www.DissertationTopic.Net  Mobile