Author(s)

Luo Jiawei

Corresponding Author

Luo Jiawei

Abstract

The Internet of Things is a new network technology that has developed rapidly in recent years. Persistent storage of IoT big data and statistical analysis of the stored data can better manage the IoT system and save IoT applications. cost. However, the big data of the Internet of Things has massive characteristics, and traditional data storage technologies and management systems are difficult to meet actual needs. In addition, the need to quickly find data requires a more efficient new storage architecture. Based on this, this paper designs the DMFS system architecture and file writing process based on the Hadoop file system, and builds a distributed file system for massive small files. An aggregate query data system is designed on the basis of probability-oriented data OLAP, and the type and implementation of the query are designed. Based on the above research, an HDFS dynamic copy management strategy based on fragile storage is proposed.

Keywords

Internet of things; big data; data storage