The best way to conference proceedings by Francis Academic Press

Web of Proceedings - Francis Academic Press
Web of Proceedings - Francis Academic Press

Design and Implementation of IT Job Recruitment Data Based on Web Crawler

Download as PDF

DOI: 10.25236/icited.2021.052


RongFu Wang

Corresponding Author

RongFu Wang


Crawler technology, as the most critical technology in data search technology, is also the core module in search engine, providing data source for search engine. In order to obtain a large amount of recruitment information existing on the Internet and reflect it locally, a web crawler system is designed to crawl this information and store it in categories. In this paper, Python web crawler technology is used to obtain job information of recruitment website and store it in database, XPath module is used to clean and crawl job data, and Struts2+hibernate is used to realize employment recommendation system. IT can be used as a reference for IT job recruitment.


Web crawler; It recruitment; Python; Analysis of data