Dissertation > Excellent graduate degree dissertation topics show

Research on Parallel Resources Mining from the Internet

Author: YanZhenXiang
Tutor: YaoJianMin
School: Suzhou University
Course: Applied Computer Technology
Keywords: Of bilingual parallel to resources Web mining Bilingual parallel sentence pairs Web de-emphasis
CLC: TP393.02
Type: Master's thesis
Year: 2010
Downloads: 64
Quote: 0
Read: Download Dissertation

Abstract


Machine translation, cross-language information retrieval , natural language processing applications have a demand of large-scale bilingual resources . Although the countries have invested a lot of manpower , material and financial resources to strengthen the construction of the bilingual corpus , but existing bilingual corpus can not meet the need to deal with real text in scale, timeliness and field balance . This paper aims to automatically obtain Algorithm based on the Web large-scale Parallel Corpus . The bilingual resources excavate Internet pages in the presence of a large number of duplicate pages need to be overcome . Similar articles by keyword search , detect duplicate articles from a similar article , this method is effective to solve the problem of efficiency and accuracy of the balance . Sentences , words between promotion iterative way to select keywords . Bilingual resource mining efficient , effective de-emphasis of the web has laid a solid foundation. Large amounts of bilingual parallel sentence pairs exist in the bilingual mixed website . This article through a full analysis of the web structure and web content mining bilingual sentence pairs . First obtain a dual - language mixed web -based search engine summary , followed by pages block select the bilingual candidate resources based on the bilingual word translation degrees , between sentences measure , MN page's HTML node alignment candidate bilingual parallel sentence pairs . Finally , based on maximum entropy model combined length , bilingual word translation degree , exist in a distance within a web page , word alignment features identified bilingual parallel sentence pairs . Network of conducting the bilingual parallel to the web page URL naming tend to have a certain regularity , this paper , by analyzing the URL for candidate parallel pages to a bilingual website . Edit distance algorithm to calculate and predefined string similarity found a bilingual website . By analyzing the web page text length , bilingual word translation degrees of anchor text , the word alignment using a classifier to identify parallel text .

Related Dissertations

  1. Web-based Mining Technology and Its Application in Digital Library,G250.76
  2. The Study and Design of the Web Sites’ Individuation and Searching Optimizing,TP393.092
  3. Method of Parallel Reomving Duplicates in Large Scale Chinese Web Pages Based on Feature Code,TP393.092
  4. Document Clustering Approach Based on Term Clustering and Association Rules,TP311.13
  5. Research on Detection of Approximate Mirror Web Pages,TP393.092
  6. Related Studied on Information Extraction and Information Recommendation Based on Web Data Mining,TP393.09
  7. The Research of Concept Lattice Pruning Method and Its Application in Web Mining,TP311.13
  8. Site Structure Optimization of WEB - based mining,TP393.092
  9. Research on Domain-Oriented Search Engines Based on User Behavior,TP391.3
  10. Research on the Realization of the Employment Information Extraction System Based on Web,TP393.09
  11. Research and Implementation of Mining Implicit User Interest,TP311.13
  12. The bookmarks service system and Web mining technology applications,TP393.03
  13. Study on Web Mining and Electronic Commerce,TP393
  14. Research of Web Log Mine Technology Based on Synthetic Resin Product System,TP393
  15. Design and Implementation of Domain-specific Business Information Retrieval System in Electronic Commerce,TP391.3
  16. Research on Application of Web Mining Technology on EA-PGR Management System,TP393.09
  17. Research and Implementation About Dynamic Balance of Computing Resources in Online Web Mining Base on Cloud Platform,TP311.13
  18. The Study and Implementation of Topic Search and Web Mining,TP391.3
  19. Research on Web User Access Clustering Pattern,TP311.13
  20. Research on Community Structure of Complex Network Based Website Clustering,TP393.092

CLC: > Industrial Technology > Automation technology,computer technology > Computing technology,computer technology > Computer applications > Computer network > General issues > Computer network architecture and design
© 2012 www.DissertationTopic.Net  Mobile