Dissertation > Excellent graduate degree dissertation topics show

Index Technology for Large Sparse Relational Datasets

Author: LiBoDuo
Tutor: LiJianZhong
School: Harbin Institute of Technology
Course: Computer Science and Technology
Keywords: indexing large sparse table structured query
CLC: TP311.132.3
Type: Master's thesis
Year: 2008
Downloads: 27
Quote: 0
Read: Download Dissertation

Abstract


In community web management systems (CWMS), storage structures inspired by large sparse tables (LST) are being used increasingly to manage sparse datasets. A LST typically embodies thousands of attributes, with many of them being undefined, and low-dimensional structured similarity search on a combination of numerical and text attributes is a common operation. However, many properties of such wide tables and their associated Web 2.0 services render most multi-dimensional indexing structures irrelevant. Recent studies in this area have mainly focused on improving the storage efficiency and efficient deployment of inverted indices; so far no new index has been proposed for indexing LST. The inverted index is fast for scanning but not efficient in reducing random accesses to the data file as it captures little information about the content of attribute values.In this paper, we propose the filter-and-refine search based iVA-file that works on the basis of approximate contents and keeps scanning efficiency within a bounded range. We introduce the nG-Signature to approximately represent data strings and improve the existing approximate vectors for numerical values. We also propose an efficient query processing strategy for the iVA-file, which is different from strategies used for existing scan-based indices. Extensive experiments on real datasets show that the iVA-file outperforms existing proposals in query efficiency significantly, while keeps an ideal update speed.

Related Dissertations

  1. Web search engine related technology research,G354
  2. Research on Fast Indexing Mechanism of P2P Based Spatial Vector Data,TP391.3
  3. Research on Locally Features Aggregating and Indexing Algorithm in Large-scale Image Retrieval,TP391.3
  4. The key component vertical search engine technology research,TP391.3
  5. Content-based image retrieval technology research large-scale digital,TP391.41
  6. Based on data mining community website user behavior analysis system,TP393.092
  7. Full database retrieval method and its application,TP311.13
  8. Research on Semantic Web Service Discovery Method Based on Interface Matching,TP391.1
  9. Research on Toponym Ontology Service Oriented Spatial Semantic Retrieval Framework,P208
  10. Recycling metal crushing test equipment and crushing mechanism,TH87
  11. Research on Distributed Service Discovery for Semantic Web Services,TP393.09
  12. Study of the XML Storage and Query Technology in Relational Database,TP311.13
  13. Design and realization of dynamic teaching evaluation management system based on ASP,TP311.52
  14. Implementation of Content-based the County Party-Governmetn Conference Video Retrieval System,TP391.41
  15. Research on Temporal Data Storage and Indexing Technology of ARTs-EDB System,TP311.13
  16. Research and Realization of Network Consensus Monitor System Based on the Incremental Text Mining,TP391.1
  17. Research and Application on Invariant Feature Points of MMS Image Retrieval,TP391.41
  18. Research of Text Clustering Based on Genetic Algorithm,TP391.1
  19. Research on Content-based Vector Engineering Drawings Retrieval,TP391.41
  20. Design and Implementation of a Lucene Based Intra-site Information Retrieval System for a Journal Site,TP391.3

CLC: > Industrial Technology > Automation technology,computer technology > Computing technology,computer technology > Computer software > Program design,software engineering > Programming > Database theory and systems > Database systems : by type > Relational database
© 2012 www.DissertationTopic.Net  Mobile