Dissertation > Excellent graduate degree dissertation topics show

Research on Text Segmentation with LDA&Graphcut

Author: LiZhen
Tutor: HanAiLi
School: Shandong University
Course: Applied Computer Technology
Keywords: text segmentation topic model graphcnt algorithm
CLC: TP391.1
Type: Master's thesis
Year: 2013
Downloads: 27
Quote: 0
Read: Download Dissertation

Abstract


Text segmentation is to obtain the boundaries between segmentations vvhieh meet the requirements of larger semantic consistency in the segmentation and smaller semantic consistency between segmentations according to topic similarity. This paper presents an improved text segmentation model, which uses the topic model as a similarity measurement method, and uses the improved graphcut algorithm to search the segmentation boundary.After overviewing the previous semantic similarity measure, we first discuss the LDA, HDP&LDA and CTM, and then try to use the three topic models to semantic similarity measure. Obtaining of topics is the basis of text segmentation. Since vocabulary is the basic semantic units of text, shallow semantic information can be got by using the simple statistics on the vocabulary of the text, and deep semantic information can be got by using the topic model. The research shows that using of LDA in text segmentation can improve the results. Compared to LDA, HDP can determine the property topics number: CTM can represent correlations among topics. Through the contrast experiments, we verify that setting the property number of topics in the topic model and using the correlations of topics can improve the effect of text segmentation.In this paper, we use graphcut algorithm which is widely used in Computer vision as text segmentation boundary search method. There is a large amount of text segmentation methods which need artificial priori parameters. These parameters tend to have a significant impact segmentation results and cannot be given desired value,(irapheut algorithm can effectively avoid this problem. In order to make the graphcut algorithm suitable to text segmentation task, this paper has done the following three aspects: lust, redefine the text segmentation border search problem as the expression of energy function that can be solved by graphcut algorithm; then redefine the graph cut algorithm dynamical graph-building step, according to the linear nature ol’ the problem; finally, the feasibility analysis. Finally, we discuss details of the improved text segmentation model based on the topic models and graphcut algorithm and it’s implementation. And then, according to the analysis of the graphcut algorithm, we combine the idea of simulated annealing with the graphcut algorithm to improve the graphcut algorithm. Kxperimental results demonstrate that the models have improved performance on text segmentation task.

Related Dissertations

  1. Research on Embed Text Extraction from Still Images,TP391.41
  2. The design and application of the tax data warehouse system,TP311.13
  3. Research on Topic Detection and Tracking Based on Probability Topic Model,TP391.1
  4. Topic Discovery and Trend Analysis in Scientific Literature Based on Topic Model,TP391.1
  5. News Threading Based on LDA Model,TP393.09
  6. Topic Model Based High Resolution Remote Sensing Image Change Detection,TP751
  7. Classification and Annotation of High Resolution Synthetic Aperture Radar Images Based on Extended Supervised Topic Model,TN957.52
  8. Supervision topic model research and application,TP391.1
  9. Click data and search results based on fragments excavated named entities,TP391.3
  10. Automatic distribution of software defects,TP311.52
  11. Research on Text Extraction from Image with Complex Background,TP391.41
  12. Study on Text Segmentation Based on Content,TP391.1
  13. The Research of Probabilistic Topic Models and Their Application in Relational Text Classification,TP391.1
  14. The Research of Automatic Single Text Summarization Based on Latent Semantic Analysis,TP391.1
  15. Research on Key Techniques of Topic-Oriented Blog Resource Mining,TP393.09
  16. Research on the Text Classification Method Based on Correlated Topic Model,TP391.1
  17. Research on Phrase-based Statistical Machine Translation,TP391.2
  18. Text Structure Analysis Based on Title Feature and Lexical Conjunction,TP391.1
  19. The Research and Implementation of Handwriting Editing System on Mobile Platform,TP311.52
  20. The Design and Implementation of Information Retrieval Subsystem of Unversities Admission and Employment Management System,TP311.52
  21. Research on Text Extraction Technique in Video Frames and Images,TP391.41

CLC: > Industrial Technology > Automation technology,computer technology > Computing technology,computer technology > Computer applications > Information processing (information processing) > Text Processing
© 2012 www.DissertationTopic.Net  Mobile