Dissertation > Excellent graduate degree dissertation topics show
Research on Cluster-based Person Name Disambiguation
Author: PeiFei
Tutor: YaoJianMin
School: Suzhou University
Course: Computer technology
Keywords: Person Name Disambiguation Evaluation Metrics Feature Extraction Clustering Algorithm Named Entity N-Gram
CLC: TP391.1
Type: Master's thesis
Year: 2011
Downloads: 97
Quote: 1
Read: Download Dissertation
Abstract
|
Named entity disambiguation is one of the most important problems in natural language processing .In named entity category, person name has strong ambiguity so that person name disambiguation is the most difficult category. Person name disambiguation is mainly applied to search engine, social network and population knowledge database and so on. Because person name ambiguity problem remains huge challenge, the international academic field has organized three English person name disambiguation evaluations (Web People Search, WePS) and one Chinese person name disambiguation evaluation(CIPS-Sighan 2010 bakeoff-3).This thesis adopt Hierarchical Agglomerative Clustering (HAC)developing an English person name disambiguation system(EPND) ,and adopt two-stage Affinity Propagation(AP) clustering algorithm developing a Chinese person name disambiguation(CPND) system.In this paper, we firstly introduce WePS and CIPS-Sighan 2010 bakeoff-3, including evaluation corpus(development data and test data),evaluation metrics, baseline system, participants , popular person name disambiguation techniques and so on.We firstly extract various kinds of features , and select effect features by means of detail experiments in EPND system. On the basis of the feature extraction and selection, we improve clustering effect by fusion of many features. In this thesis, we adopt comparative maturely hierarchical clustering algorithm(HAC) to implement EPND system,?but choice of linkage is group-average link not single link .The experiment results shows group-average is better than single link.We adopt an iteratively greedy algorithm called jumping-distance tree to extract N-Grams of the context person appears in CPND system, whose similarity measure is the smoothing TF*IDF weighting. Results show it can deal with Chinese word segmentation problem so that realize the recognition of discarded documents. And we adopt two-stage AP clustering algorithm, the first stage of which ensure high precision and the second stage of which improve the recall. Results show it is useful, and the result of diagnostic test shows the segmentation effect of Chinese words also has important influence for disambiguation.
|
Related Dissertations
- Research on Fuzzy C-Mean Clustering Algorithm Based on Particle Swarm Optimization and Shuffled Frog Leaping Algorithm,TP18
- Research of Diagnosing Cucumber Diseases Based on Hyperspectral Imaging,S436.421
- Detection of Class Ⅰ Integron in Gram-negative Bacteria,R446.5
- Theory and Practice of Ant Clustering and Partitioning-based DBSCAN Clustering,TP311.13
- The Application of Data Mining Technology in the Performance Evaluation of Higher Vocational College Teachers,TP311.13
- Method Based on AHP-GRAM "M Real Estate" Investment Risk Evaluation,F224
- Research on Approximate String Matching and Its Application on URL Detection,TP393.08
- P2P streaming feature extraction technology research and implementation,TN919.8
- Research on Recognition Method of Space Target Based on Image Features,TP391.41
- A sample based on clustering neural network self- learning system,TP391.6
- Learning Based Structured Image Model Extraction and Tracking,TP391.41
- Research on Key Technology in Bus Realtime Information Service,TP399-C6
- Automatic Control System of Dust Fan Based on Graphics Analysis,TP273
- The Research of Sentiment Analysis Techniques for Short-Texts,TP391.1
- A Research on Attribute-Weighting Cluster Algorithm,TP311.13
- Application Research of the Improved Watershed Algorithm in Medical Image Segmentation,TP391.41
- Term Weight-Based Chinese Text Classification Algorithm,TP391.1
- Research on Railway Freight Car Licence Recognition Algorithm,TP391.41
- Research on Feature Extraction Methods in Color Face Images,TP391.41
- The Application of Web Data Mining Technology on Network Education BBS,G434
- The Research of Product Feature Extraction in B2C Website,TP311.13
CLC: > Industrial Technology > Automation technology,computer technology > Computing technology,computer technology > Computer applications > Information processing (information processing) > Text Processing
© 2012 www.DissertationTopic.Net Mobile
|