Dissertation > Excellent graduate degree dissertation topics show

Word Activation Force Model Based Chinese Word Detection

Author: ZhangYongTian
Tutor: GuoJun
School: Beijing University of Posts and Telecommunications
Course: Signal and Information Processing
Keywords: activation effect sparse matrix big data processing wordactivation force word detection word segmentation
CLC: TP391.1
Type: Master's thesis
Year: 2013
Downloads: 17
Quote: 0
Read: Download Dissertation

Abstract


Word segmentation is a key process in Chinese information automatic processing. However, the common used word segmentation method, string matching, is highly depended on the completeness and correctness of word dictionary. Today, in the Internet age, many new words are created and used, as while as many old words are dropped. The traditional manual way of maintaining word dictionary, is not able to catch up with the high speed of word dictionary updating in Internet age. More automatic, more computable way of word detection is needed to meet the strong demand of Chinese information processing.A Word Activation Force (or WAF) based word detection method is used in this article, to explore how Chinese word is made up, by analyzing big text data in a special statistical way. WAF is a statistical model to analyze the activation effect in text data. It can well model the relationship between characters, words or entities. In this article, text is assumed to be character sequences, and characters are connected by activation relationships. Based on this assumption, a WAF model is built to analyze how word is made up from characters. In this article, research status of this field is first mentioned. The WAF model is introduced then. Then the WAF algorithm procedures are designed and implemented, including the big data processing method. After that is the word detection rule experiment, with a conclusion of statistical rule of word making up. Finally, a conclusion of the whole article is made, together with future works.

Related Dissertations

  1. Chinese word segmentation based on understanding of system design and implementation,TP391.1
  2. The Research on Full-Text Search and Related Technologies,TP391.3
  3. Research and Implement of Chinese Word Segment Techniques Based on the Conditional Random Field,TP391.1
  4. Research on the Fingerprint of Short Texts,TP391.1
  5. Research on Approaches of the Subjective Automated Assessment,TP391.1
  6. Opinion Mining Based Product Usability Modeling and Evaluation,F274
  7. The Study of Chinese Word Segmentation on Uygur Students’and Han Students’ Eye Movement,B842.3
  8. The Application of Web Data Mining Technology on Network Education BBS,G434
  9. The Study of College Digital Campus Web Information Filtering,TP393.09
  10. Based WebHarvest the Chinese financial news search engine design and implementation,TP311.52
  11. Chinese XML Compression Technology,TP311.11
  12. Corporate e-mail monitoring system design and implementation,TP393.098
  13. Method of Mission Reliability Analysis of Large PMS Based on Markov Model,V556
  14. Study of Chinese morpheme -based lexical analysis methods,TP391.1
  15. The Application Research of Chinese Word Segmentation Algorithm in GIS,TP391.3
  16. GPU-based acceleration techniques EDA,TP391.41
  17. Intelligent Analysis and Implement of Compliant Information Based on Filter Technology,TP391.1
  18. Probability and statistics based on dictionaries and Chinese word segmentation algorithm,TP391.1
  19. Research and Implementation of Website Search Technology Based on Ajax/Lucene,TP393.092
  20. Design and Implementation of Data Management System of the Harmful Internet Video Information,TP393.06
  21. The Study and Analysis of Oracle Bone Inscriptions Based on Statistical Natural Language Processing,TP391.1

CLC: > Industrial Technology > Automation technology,computer technology > Computing technology,computer technology > Computer applications > Information processing (information processing) > Text Processing
© 2012 www.DissertationTopic.Net  Mobile