Dissertation > Excellent graduate degree dissertation topics show

Research on Several Methods of Data Classification in Adapting to Bad Data

Author: LiJunLin
Tutor: FuHongGuang
School: University of Electronic Science and Technology
Course: Computer Software and Theory
Keywords: data classification data clustering pattern recognition molecularkinetic theory bad data
CLC: TP311.13
Type: PhD thesis
Year: 2012
Downloads: 67
Quote: 0
Read: Download Dissertation

Abstract


Some characteristics of data can have negative effects on data categorization, such as noise pollution, density variance between clusters, class imbalance, different variances on different dimensions and so on. Therefore, the research of classification approaches that can be adaptable to bad data is importantly valuable in theory and practice. Although the present classification approaches such as DBSCAN and Trimmed k-means can deal with bad data of some characteristics, the eagerness for a general approach that is adaptable to all kinds of bad data is unrealistic. So, the research on anti-jamming approaches pertinent to data characteristics has become a common view.Inspired from molecular kinetic theory and concerning the information on neighbourhood,cluster density variance and the distance in original and iterating spaces, Molecular dynamics-like Data clustering Approach is proposed in this dissertation; Similarly considering neighbourhood information and (or) feature variance, Ellipsoid-plane classification Approach is designed, and KDE-based classification approach is improved in this paper. Besides being adaptable to noise and great density variance between clusters, the new clustering approach is able to automatically find possible clusters without presetting cluster number. This approach has solved "Black Hole" problem encountered by gravitational model.KDE-based data classification algorithm is one of the classification approaches widely used in different applications. Dealing with class imbalance data, it has the problem of misclassifying data of minority class into majority class. In order to enable this approach to cope with class imbalance data, and to be effective even when class imbalance problem is acute, this paper propose an improvement that is to add a small-searching-interval smooth factor into this approach. Experiment results showed the effectiveness of the improvement.In the phase of class prediction, classification methods like the KDE-based approach can be involved in computing the whole data, so that computation cost in this phase is rather high. In order to reduce prediction cost and to make classification model embrace variance information on feature dimension, a new Ellipsoid-plane classification approach is proposed in this paper. It is a two-stage supervised method, which uses elliptic surface and plane as reference surfaces for classification. Because the computation in classifying phase only involves testing point and reference surfaces, the computation cost in this phase is less than the distance-based k-nn method and the KDE-based approach. Moreover, ellipsoid-plane classification approach also strengthens neighbourhood principle.Besides theoretical analysis, the approaches mentioned above are also compared with other present methods in experiments, which has confirmed rightness of the theoretical derivations, and provides a new and valuable exploration in bad data classification.

Related Dissertations

  1. The Classification of High Dimsnsion Flew Field Based on Manifold Learning,V231.3
  2. Research on Text Classification Based on Biomimetic Pattern Recongnition,TP391.1
  3. Research on Identification System of Cashmere and Wool Fiber,TS101.921
  4. Intrusion detection based on the ultrasonic echo envelope in the military security patrols,E919
  5. Research on Clustering and Aligning Methods for Gene Expression Time Series Data Analysis,TP311.13
  6. SAW gas sensor array pattern recognition technology research,TP212
  7. 3D Face Recognition Based on Biomimetic Pattern Recognition,TP391.41
  8. Research and Implementation of Liver Cancer Identification Based on Improved SVM Model,TP391.41
  9. Research on Clustering Algorithm Based on Quantum Theory,TP311.13
  10. The Research for Fractal Feature Extraction and Face Recognition Algorithm,TP391.41
  11. Rules Extraction from Artificial Neural Networks for Classification Based Improvedant Colony Algorithm,TP183
  12. Recognition and Implementation of Multi-sintering Condition Based on Complete Binary Tree Supporting Vector Machine,TP391.41
  13. Research and Implementation on Sintering State Prediction Method Based on SVM and PSO,TF821
  14. The Study of Coal Calorific Capacity Based on Texture Feature,TP391.41
  15. Research and Application of the Data Correction Technology in the Petrochemical MES System,TP315
  16. Classifier Design and Weight Optimization Methods Based on Multiple Views,TP18
  17. SVM Based on SIFT and scene classification,TP391.41
  18. Smartphone dimensional code recognition system design and implementation,TN929.53
  19. Gene expression data analysis of clustering algorithm,TP311.13
  20. Research on Characteristic Analysis and Recognition Algorithm of Heart Sound Signal,R318.04
  21. GIS-based geological disaster-prone district levels Evaluation System,P694

CLC: > Industrial Technology > Automation technology,computer technology > Computing technology,computer technology > Computer software > Program design,software engineering > Programming > Database theory and systems
© 2012 www.DissertationTopic.Net  Mobile