|
The main research topic is based on the Web news automatic capture program, through the analysis of news webpage source code, and then to extract useful information. According to the actual work requirements, in the analysis present news crawl process on the basi s of the pri nci ple of combi ni ng news, graspi ng the concept of development, structure and system development and the basic principles, design and development of the news crawl process. The system is based on B/S structure, using a single thread asynchronous I/O model, selected three object collection, the use of Active Server Pages, VBSCRIPT language, MySQL database development and design.This paper mainly expounds the Web data mining technology and information collection technology research status at home and abroad and the trend of development, and on the two technology in-depth study, according to control engineering idea, the system needs analysis, detailed design and the realization, finally tested, so that the system is practical.
|