Dissertation > Excellent graduate degree dissertation topics show

Reverse Backtracking Research of Chinese Segmentation Based on Last Word Dictionary

Author: LiangZuo
Tutor: LiYuSheng
School: Wuhan Polytechnic University
Course: Mechanical and Electronic Engineering
Keywords: Chinese word segmentation segmentation algorithm the last word dictionary hash structure eliminate ambiguity
CLC: TP391.1
Type: Master's thesis
Year: 2010
Downloads: 71
Quote: 0
Read: Download Dissertation

Abstract


Chinese word segmentation is the first step in Chinese information processing, Chinese information processing performance is decided by its precision and efficiency. Chinese information processing technology is applied in the search engine, text proofreading, speech recognition, machine translation, Chinese word segmentation as its basis, promoting the development of Chinese information processing technology to meet the needs of various applications is of great practical significance.The article introduces the meaning, status and the current difficulties in Chinese word segmentation technology and carries on the essential analysis to the present several kinds of commonly used Chinese word segmentation technology. With the support of "Semantic Web-based semi-structured information extraction technology and its application" in Hubei Province Department of Education research project, It focuses on Chinese word segmentation based on string matching, on the one hand, a last word dictionary based Hash structure is designed to record words length, achieve to save storage space, help to reduce the matching process occur in the number of invalid matches, then increase the efficiency of the segmentation; on the other hand focuses on the core algorithm based on this dictionary designed to solve the existence problems of ambiguity in Chinese word segmentation. According to the characteristic of modern Chinese statement, the reverse maximum matching methods are often higher than the maximum matching word segmentation method in precision, the reverse backtracking algorithm is designed. The possible ambiguities of the segmentation are eliminated by the backtracking mechanism of improved algorithm.To verify, it uses Access to complete a small dictionary with Hash structure, using Delphi to achieve the reverse backtracking maximum matching algorithm, and take the achievement as experiment system, selected the People’s Daily on April 16 Yushu in Qinghai Province earthquake relief project report of the three original articles for the corpus to the test, and compared with forward maximum matching and reverse maximum matching, the experimental results confirm that the design to improve the effect of segmentation efficiency and eliminate ambiguities is obvious. Meanwhile, the test results are analyzed in detail, the system can most effectively eliminate the overlapping ambiguities, but the effects of combination ambiguities were not obvious.

Related Dissertations

  1. Road extraction algorithm based on region segmentation of remote sensing image,TP751
  2. Segmentation of cDNA Microarray Image Using Fuzzy C-means Algorithm Optimized by Particle Swarm,TP391.41
  3. Research and Implement of Chinese Word Segment Techniques Based on the Conditional Random Field,TP391.1
  4. Research on Approaches of the Subjective Automated Assessment,TP391.1
  5. The Application of Web Data Mining Technology on Network Education BBS,G434
  6. Research on A Single-Pole Magnetic Encoder Used in the Frame Platform of the Coordinator,TH712
  7. Research on Retrieval of Network Multimedia Educational Resources Database,G434
  8. Full-text search engine used in the design and implementation of e-mail,TP391.3
  9. Development of Civil Aviation Dictionary Appliaction System Based on J2EE,TP311.52
  10. University BBS Retrieval System Design and Implementation,TP393.094
  11. Search engine for the field of art education applications,J20-4
  12. Research on IPTV Video Content Analysis and Filtering,TN949.292
  13. Research and Application of Internet Chinese Text Classification,TP391.1
  14. One kind of Chinese unknown word recognition and new design method dictionary,TP391.1
  15. Study of Chinese Text Similarity Based on Number Difference Gene,TP391.1
  16. Based on non- parametric model for image segmentation method,TP391.41
  17. The Studies on Chinese Text Categorization Based on Pso and Svm,TP391.1
  18. Exudates Segmentation in Retinal Images Based on Boosted Soft Segmentation Algorithm,TP391.41
  19. The Research of Word Index Method Based on Inter-Relevant Successive Trees Model,TP391.3
  20. Research on Named Entity Recognition Based on Rules,TP391.1

CLC: > Industrial Technology > Automation technology,computer technology > Computing technology,computer technology > Computer applications > Information processing (information processing) > Text Processing
© 2012 www.DissertationTopic.Net  Mobile