Dissertation > Excellent graduate degree dissertation topics show

Hash -based word segmentation mechanism design and implementation

Author: WangQuanLi
Tutor: FuYan
School: University of Electronic Science and Technology
Course: Computer Software and Theory
Keywords: Word dictionary Hash AVL tree TRIE index tree
CLC: TP391.1
Type: Master's thesis
Year: 2008
Downloads: 298
Quote: 4
Read: Download Dissertation

Abstract


Chinese dissemination of information as an important human language tools, Chinese information processing has become a hot research field of information processing problems . Chinese word segmentation is an important component of Chinese information processing part and dictionary processing efficiency is affected Chinese word segmentation system performance is a key factor , therefore , to establish efficient word dictionaries have significant meaning. In this paper, Chinese word segmentation system dictionary structure in-depth study , made ??some research, have been used for 863 projects in the spam messages monitoring process, and the design of algorithms related patent applications filed , the main results are as follows : 1. comparative analysis and improved several dictionary storage and processing methods : Array - array mechanism uses an array of storage entry line , using binary search , the operation efficiency is not high, is not conducive to the dictionary update ; hash of the former two-word entry word hashes, using depth of 2 TRIE tree structure is complex ; quadword hash mechanism is only valid for the four-character idioms , there are limitations in the application . In this paper, these methods make certain improvements to address efficiency issues . (2) According to the characteristics of Chinese GB code , proposed a more efficient storage algorithm dictionary , the first word of the same entry is stored as a text line , and each entry is formatted as : removing the first word entry name , entry hash values ??and related properties , improved utilization of storage space . 3 Use the Hash table lookup efficiency advantages Hash mechanism proposed based dictionary lookup , update , delete, add new algorithms and other operations . Hash functions designed a practical , after experimental verification collision rate is extremely small, suitable for small and medium sized dictionary by improving the function is suitable for large dictionary of non-conflict Hash functions . 4 . Implement arrays, linked lists , AVL tree , Hash Table ( with minimal conflict and non-conflict two kinds ) five kinds of dictionary structure algorithms, these algorithms from time complexity and space complexity and other aspects of detailed analysis and evaluation , from load , write , file size and operating time , and several other aspects of experimental comparison , verification mechanism based Hash algorithm dictionary structure than traditional algorithm improves space utilization by nearly two times in the time efficiency improved by 5 ~ 6 times . 5 Using Java to achieve a dictionary based on Hash structure module mechanism , and proposed the algorithm in terms of the expansion program on the property .

Related Dissertations

  1. Research on the Storage of Condensed Cube Based on Flash Memory,TP333
  2. Research on the Low-cost RFID Systems Security Protocol,TP391.44
  3. Design of AHB Monitor Based on SHA and AES Algorithms,TP309.7
  4. RFID Authentication Protocol Based on Hash Function,TP391.44
  5. Research and Application of Data Storage in the WAN Optimization,TP333
  6. High flow conditions P2P streaming real-time behavior recognition system design and implementation,TN919.8
  7. Deduplication technology research and implementation,TP333
  8. Hash based on structured sparse spectrum image indexing algorithm,TP391.41
  9. Semi-supervised hashing algorithm based Image Retrieval Methods,TP391.41
  10. SSD controller wear leveling algorithm,TP333.35
  11. And asymmetric VLAN 's core technology research,TP393.1
  12. Research on the Security Protocol of Air Interface for RFID System,TP391.44
  13. Wireless sensor network key management scheme,TN918.82
  14. Research on Key Update Scheme in Wireless Sensor Networks,TP212.9
  15. Audio retrieval technology in the digital voice teaching system application and research,TP391.6
  16. Distributed intelligent semantic search method based on cloud computing,TP391.1
  17. Research and Analysis of Self-adaptive Image Encryption Algorithm Based on Hash,TP309.7
  18. Research on Automated Selection of Hash-style Habitation,P283
  19. Based on Euler path parallel DNA sequence assembly,Q78
  20. Monte Carlo program point energy nuclear data processing method research and Optimization,TL329.2
  21. Research and Implementation of Dynamic Password Authentication Scheme Based on Ecc,TP393.08

CLC: > Industrial Technology > Automation technology,computer technology > Computing technology,computer technology > Computer applications > Information processing (information processing) > Text Processing
© 2012 www.DissertationTopic.Net  Mobile