Design of Big Data Processing System Based on Stream Computing Storm
Download as PDF
DOI: 10.25236/cseem.2020.001
Corresponding Author
Bao Ling
Abstract
Aiming at the real-time, volatile, and disorderly characteristics of big data streams, this paper takes optimizing Storm stream computing as a cornerstone, and proposes a big data real-time stream processing system based on the Storm stream computing engine. The system can not only realize data collection, data buffering and streaming calculations, but also meet the fast processing needs of condition monitoring anomaly detection and data analysis, as well increase the component throughput of the sliding window and improve the real-time processing efficiency of condition monitoring anomaly detection. This study lay the foundation for cloud manufacturing platform, it has a practical significance.
Keywords
Big Data, Real-time Streaming, Stream Computing