Author(s)

RongFu Wang

Corresponding Author

RongFu Wang

Abstract

Crawler technology, as the most critical technology in data search technology, is also the core module in search engine, providing data source for search engine. In order to obtain a large amount of recruitment information existing on the Internet and reflect it locally, a web crawler system is designed to crawl this information and store it in categories. In this paper, Python web crawler technology is used to obtain job information of recruitment website and store it in database, XPath module is used to clean and crawl job data, and Struts2+hibernate is used to realize employment recommendation system. IT can be used as a reference for IT job recruitment.

Keywords

Web crawler; It recruitment; Python; Analysis of data