Dissertation > Excellent graduate degree dissertation topics show

The Study of Maximum-Match-Based Written Chinese Automatic Segmentation

Author: YangChao
Tutor: LiRenFa
School: Hunan University
Course: Applied Computer Technology
Keywords: Chinese word Maximum matching Two words Segmentation ambiguity Pseudo ambiguity Unknown word recognition Precision
CLC: TP391.1
Type: Master's thesis
Year: 2004
Downloads: 415
Quote: 6
Read: Download Dissertation

Abstract


Written Chinese word segmentation is an important Chinese information processing step , it is a text proofreading, machine translation details , text categorization , text retrieval, computer human interface applications , and many other Chinese information basis . At present Chinese word segmentation method consists of string-based matching method , based on statistical methods and methods based on understanding . This paper analyzes the existing automatic segmentation algorithm based on , focusing on string matching based Chinese word segmentation algorithm , the introduction of pre- maximum matching segmentation , while the use of statistical methods for segmentation ambiguity and unknown word recognition . According to Chinese two words more , it presents an improved automatic segmentation dictionary mechanism, which increased in the dictionary data structure two words detection bit charts. On this basis, the maximum matching segmentation algorithm is improved to achieve a chart based on two detection bit words maximum matching segmentation algorithm, the algorithm uses two words detection bit chart quickly determine two words , reducing the number of dictionary matching , to improve the automatic segmentation speed. For high-frequency spurious ambiguity maximal overlapping ambiguities in a large corpus showed strong stability and a certain degree of coverage , ambiguity treatment focused on the study of automatic acquisition of such ambiguities , they are recorded in the form of the right to split library ambiguity , which ambiguity resolution achieved through direct look-up table , which in essence is a memory-based strategy. Unknown word recognition technology research focuses on Web resources for unknown words and propose a Web-based query saying chi unknown word recognition algorithm, the algorithm analyzes Web search query logs keyword frequency table identifies unknown words . Based on the above findings, the design and implementation of a practical application for the written Chinese word segmentation system . The experimental results showed that: Under the same conditions , based on two charts detect bit word segmentation algorithm for maximum matching algorithm than the original word faster. Carnegie Mellon University using the word evaluation system for evaluation, evaluation results show that the two words detection bit graph algorithm for maximum matching segmentation precision rate increased 3.57%, F-1 measure increased 0.01 , better than the original algorithm performance. The system also has good stability.

Related Dissertations

  1. Design and Simulation of Hot Precision Forging Die for Spur Bevel Gear,TH132.41
  2. Development of a multi- speed radar measurement system answering machine,V556
  3. Research and Implement of Chinese Word Segment Techniques Based on the Conditional Random Field,TP391.1
  4. A High-Performance Audio ∑△ ADC in 65nm CMOS Process,TN792
  5. Research on Approaches of the Subjective Automated Assessment,TP391.1
  6. The Study of Implementation Technology of Time Synchronization for Packet Transport Networks,TN915.09
  7. Key Technology Research on Digital Design of Complex Surface Parts in Engine,TK402
  8. Based WebHarvest the Chinese financial news search engine design and implementation,TP311.52
  9. Chinese XML Compression Technology,TP311.11
  10. RFID tag packaging equipment truss speed high-precision motion control,TP273
  11. Small mobile online water quality monitoring system,TP274
  12. Corporate e-mail monitoring system design and implementation,TP393.098
  13. Macro- micro dual-drive platform for the realization of high-precision two-dimensional motion,TH703
  14. Simulation and Analysis for Dynamical Transmission Precision of 2K-V Cycloid Pin Gear Reducer Based on Multi-body System Dynamics,TH132.46
  15. Intelligent Analysis and Implement of Compliant Information Based on Filter Technology,TP391.1
  16. Probability and statistics based on dictionaries and Chinese word segmentation algorithm,TP391.1
  17. Research on Contour Reconstruction Algorithm and DEM Accuracy Evaluation,P208
  18. Characteristics Analysis and Optimization for the Spindle Unit of High-speed & High-precision CNC Lathe,TG519.1
  19. Research and Implementation of Website Search Technology Based on Ajax/Lucene,TP393.092
  20. Research and Implementation on Hot Topic of Chinese Webpage Retrieving System,TP393.092
  21. Optimization of SOM Algorithm and Application in Chinese Text Clustering,TP391.1

CLC: > Industrial Technology > Automation technology,computer technology > Computing technology,computer technology > Computer applications > Information processing (information processing) > Text Processing
© 2012 www.DissertationTopic.Net  Mobile