|
The era we live in is the one of information explosion,people enjoy the convenience of the Internet,is facing a flood of how such content accurately, and quickly find the information they need,so the Internet search engines have emerged.Search engine spiders can adapt to how the procedures colored variety of website and the efficiency of the word segmentation become the merits of one of the important criteria.Therefore, the establishment of the spiders to meet various websites, efficient segmentation procedures and the establishment of the rapid indexing of searchengines rapid development, performance optimization are great significance.We start with the vertical search engine concept, principle,composition, workflow research and the analysis.Compared to other types of search engine merits,noting that vertical search engine market and development direction.Then,through the three modules of network spiders,segmentation and index,We get the Multi-angle analysis of vertical search engines and design,and point out of the actual needs,appropriate improvements.Among them,the spiders can deal with the mainstream news portal,blog and forum for download,analytical and standardization; Participle can only face some specific keyword participle to reduce system overhead in this regard,and to prepare for the index;Finally,according to the segmentation information,the indexing module finish the index and search work.Through this analysis,there is a gradually optimization method to make the Spider module in analytic aspects of the new website will be more efficient,where the software development and maintenance process in future,and the upgrade of the Keywords will become simple,then the segmentation of the words will become more effective, the index speed will improve.It will supply a solid foundation for further extensions, shortening the development cycle and adapting the new demand.
|