Dissertation > Excellent graduate degree dissertation topics show

Chinese Spoken Document Retrieval Method Based on Stop-word Processing

Author: JiangBin
Tutor: LiHaiFeng
School: Harbin Institute of Technology
Course: Computer Science and Technology
Keywords: Chinese SDR stopword entropy syllable lattice VSM
CLC: TP391.1
Type: Master's thesis
Year: 2008
Downloads: 76
Quote: 2
Read: Download Dissertation

Abstract


As the development of Internet and multi-medial techonology, the amount of spoken doucuments has increased rapidly. An effective retrieval method for spoken doucuments becomes more and more important. As a new field of speech recognisition ,the aim of SDR (spoken document retrival)is to search in the collection of spoken documents and return the query-related spoken doucuments segmentation or spoken documents to users. Based on indexes of spoken documents created beforehand, it can search effectively based on content.This paper investigates the strategy to improve the performance of Chinese SDR.according to frequent occurency of stop-word in spoken documents, this paper introduces the technology of stop-word processing to SDR.Stop-word is defined as these words that appear frequently in documents but make no sense for retrieval. There must be negative influence to the performance of SDR because of the introduction of non-content stop-word. Because of the particularity of SDR, this paper applying the entropy mehod to extract stop-word,designed the algorithm of stop-word extraction. comparing with the word-frequency mothod ,this method has better performance and reflects the context better.this paper supplys a whole on-line processing of spoken document retrieval, which includes the creation of index based on syllable lattice, the similarity calculation between query and spoken document based on vector space model, orders the result according to similarity and outputs results to users. Every spoken document is presented by a feature vector, which is constructed based on syllable lattice. Extracting the acoustic score of syllable and syllable-pair from every spoken document by searching every syllable lattice of spoken documents to form the feature vectors of spoken documents. Because of the error rate of the ASR(automatic speech recognizer) and multiple characters per syllable, we weighted syllables of stop-word by a punished value to reduce the weight of stop-word syllable in the feature vector, the value is set 0.1 through comparing retrieval results of different value. The cosine similarity is used to estimate the relevance between the query and the document. By experiments, the improved system has a good improvement compared with the baseline system.The main contributions of this paper are: proposing the stop-word extracting algorithm based on left-right entropy, extracting stop-word properly from syllable lattice .proposing the improved VSM based on stop-word punishment and improving the performance of retrieval system.

Related Dissertations

  1. Numerical Simulation of Polarized Radiative Energy and Entropy Transfer,TK124
  2. Research of Irreversible Loss in Flow and Mexed Prosess,TK12
  3. Quantitative evaluation model based on information entropy of the classroom observation,G632.4
  4. Research on Domain Entity Attribute and Event Extraction Technology,TP391.1
  5. Research on Extraction and Tracking of People’s Opinion,TP391.1
  6. Research on Removal Algorithm of Shadows in Image Segmentation,TP391.41
  7. Research on Feature Extraction and Classification of Doppler Ultrasonic Blood Flow Signals of Wrist Radial Artery,TP391.41
  8. Gao Zhong-ying academic thought and experience and use of Bufei Decoction treatment of common diseases of the respiratory system drug law,R249.2
  9. The Research on Evaluation Method of Highway Ecosystem Healthy,X826
  10. DR Stinson \,TN918.1
  11. FEICHENG blending coal distribution center model,F259.2;F224
  12. Researches on Urban Rail Transportation Operation Management System Test and Evaluation Method,TP311.52
  13. The Frame Disambiguation of Automatic Identification of Chinese Frame,TP391.1
  14. Quantum Decoherence in Dissipative Cavity System,O413.1
  15. A Study of Multi-Path Routing Algorithm of Wireless Sensor Networks Based on Energy Balance,TP212.9
  16. The Research on the Marketing Mode of Suzhou Three Value Instrument Co.,Ltd,F426.4
  17. Evaluation of Economic Forecasting-model by Entropy,F201
  18. The Research on Object Matching Based on Major Color Spectrum and Spatial Distribution Entropy,TP391.41
  19. Image Spam Detecting Based on Combinatorial and Statistical Classifier,TP391.41
  20. The Selection and Evaluation of Logistics Supplier in HY Company,F426.7

CLC: > Industrial Technology > Automation technology,computer technology > Computing technology,computer technology > Computer applications > Information processing (information processing) > Text Processing
© 2012 www.DissertationTopic.Net  Mobile