Dissertation > Excellent graduate degree dissertation topics show

Research on Acquiring Bilingual Parallel Sentences and Building Corpus

Author: LiuFei
Tutor: LiuTing
School: Harbin Institute of Technology
Course: Computer Science and Technology
Keywords: Parallel corpus Bilingual alignment Quality evaluation Fielddemarcation
CLC: TP391.2
Type: Master's thesis
Year: 2013
Downloads: 13
Quote: 0
Read: Download Dissertation

Abstract


In recent years, the explosive growth of information on the Internet hasprovided new opportunity for statistical machine translation, and many researchgroups as well as commercial institution have begun to obtain bilingual corpus fromthe Internet on a large scale.The advantages and disadvantages of machine translation model are closelyrelated with the scale and quality of corpus. The scale of the data acquired from theInternet is much larger than the traditional way of manual collection, but theproblem of how to ensure the quality of the corpus and build corpora for machinetranslation has become a priority issue.In the field of machine translation, sentence alignment method based onmultiple features fusion between sentences have become mature, which can be usedin corpora of good quality and get good results. For appraisal of machine translationsystem, there have been a variety of common techniques, including BLEU that hasbeen a main evaluation technology which scholars always adopt since its invention.BLEU yields its score according to level of similarity between artificial translationas a reference and the output of machine translation. In the field of textclassification, for feature extraction and classification algorithm we also havedifferent relevant methods based on different situations.The main content of this paper focuses on the above three aspects. First, for thesentence alignment of bilingual parallel corpora, we adopt a multi-feature fusiontechnology of sentence alignment by mirroring TFIDF. We made a few alteration sothat it can adapt to the noise of the Internet language, added the paragraph alignmentmodule, segmented long texts, and texts with noise are aligned head to tail to solveor weaken the problem of noise; Second, for the quality evaluation of corpora, wereplaced the human translation by the output of online translation system as areference, and the BLEU algorithm is used for quality assessment to get the score.This method, compared with human translation is more efficient, so it can be appliedon large-scale corpora; For field demarcation, we tried a variety of feature extractionand classification algorithm and found appropriate combination which is moresuitable for the Internet corpora.The attempts on these three aspects have achieved good results to some extent.Through the experimental result, we have proved the availability of relatedtechnologies we used when establishing bilingual parallel corpus, namely alignmentmethod, quality evaluation method and the field demarcation method.

Related Dissertations

  1. Multi-currency Notes Technology Research and Implementation,TP391.41
  2. Comprehensive Evaluation of Flue-cured Tobacco Quality in Pingdingshan and Comparative Analysis with American Tobacco,S572
  3. Model and Design for Teaching Evaluation System at Higher Institutions,TP391.6
  4. Teaching Quality Assessment Expert System Analysis and Design,TP311.52
  5. Environmental audit quality indicators and methods of evaluation,F239.6
  6. Research on Teaching Quality Evaluation Based on Partial Least Squares Regression and Fuzzy Comprehensive Evaluation,G647
  7. Regular data -oriented simulation of rice growth model,S511
  8. Tarzan Baishouwu standardized planting and Quality Evaluation,S567.239
  9. Study on Teaching Quality Evaluating Index System of Academic Course,G642.4
  10. Investigation and Environment Quality Evaluation of Ecological Environment in Farming-Pastoral Region of Southwestern China with Remote Sensing Technique,X171
  11. An Evaluation on the Quality of Utilizing FDI in China,F832.6
  12. Research on the Evaluation System of Independent Audit Quality about Listed Companies in China,F239.4
  13. Design and Implementation of Subsidiary Decision Support System to Water Resource Protection in Reservoir,TP311.52
  14. Research and Realization of Teaching Quality Evaluation System Based on Web Services,TP393.09
  15. Research on Education Quality Evaluation System for the Master of Management Discipline in China,G643
  16. Diversified Teaching Quality Evaluation System of Independent Colleges,G642.4
  17. Empirical Study of Teaching Quality Evaluation of College Teachers,G642.4
  18. Research into Application of Rough Set Theories in Teaching Quality Evaluation in Senior Vocational Schools,TP18
  19. The Body of Appearance and Particularly Item the Character of Our Country Excellnet Changquan and Taiji Athlete Be Simple to Evaluate Model of,G852.11
  20. Junior High School PE Teachers’ Professional Qualities of Constructing Evaluation Index System,G633.96
  21. The Research of Quality Evaluation and Selection of Reserve Drillmasters in Military Driver-training Organization,E251

CLC: > Industrial Technology > Automation technology,computer technology > Computing technology,computer technology > Computer applications > Information processing (information processing) > Translator
© 2012 www.DissertationTopic.Net  Mobile