Author(s)

Yaning Yan

Corresponding Author

Yaning Yan

Abstract

With the widespread popularity of computers and networks in people's work and life, the amount of data has increased dramatically. Nowadays, how to collect and store the data effectively is the main problem that needs to be solved. Based on Hadoop technology, this paper gives the system requirement analysis, system architecture design and key modules design of massive data processing platform, and elaborates the key points of the data processing platform development based on Hadoop technology to provide some references for the relevant researchers.

Keywords

Data processing platform, Big data, Hadoop.