New parallel processing strategies in complex event processing systems with data streams
Sensor network–based application has gained increasing attention where data streams gathered from distributed sensors need to be processed and analyzed with timely responses. Distributed complex event processing is an effective technology to handle these data streams by matching of incoming events t...
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Wiley
2017-08-01
|
| Series: | International Journal of Distributed Sensor Networks |
| Online Access: | https://doi.org/10.1177/1550147717728626 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849435349695070208 |
|---|---|
| author | Fuyuan Xiao Cheng Zhan Hong Lai Li Tao Zhiguo Qu |
| author_facet | Fuyuan Xiao Cheng Zhan Hong Lai Li Tao Zhiguo Qu |
| author_sort | Fuyuan Xiao |
| collection | DOAJ |
| description | Sensor network–based application has gained increasing attention where data streams gathered from distributed sensors need to be processed and analyzed with timely responses. Distributed complex event processing is an effective technology to handle these data streams by matching of incoming events to persistent pattern queries. Therefore, a well-managed parallel processing scheme is required to improve both system performance and the quality-of-service guarantees of the system. However, the specific properties of pattern operators increase the difficulties of implementing parallel processing. To address this issue, a new parallelization model and three parallel processing strategies are proposed for distributed complex event processing systems. The effects of temporal constraints, for example, sliding windows, are included in the new parallelization model to enable the processing load for the overlap between windows of a batch induced by each input event to be shared by the downstream machines to avoid events that may result in wrong decisions. The proposed parallel strategies can keep the complex event processing system working stably and continuously during the elapsed time. Finally, the application of our work is demonstrated using experiments on the StreamBase system regardless of the increased input rate of the stream or the increased time window size of the operator. |
| format | Article |
| id | doaj-art-e53e0c7cf2a94ef78ca62c998cf82f9b |
| institution | Kabale University |
| issn | 1550-1477 |
| language | English |
| publishDate | 2017-08-01 |
| publisher | Wiley |
| record_format | Article |
| series | International Journal of Distributed Sensor Networks |
| spelling | doaj-art-e53e0c7cf2a94ef78ca62c998cf82f9b2025-08-20T03:26:20ZengWileyInternational Journal of Distributed Sensor Networks1550-14772017-08-011310.1177/1550147717728626New parallel processing strategies in complex event processing systems with data streamsFuyuan Xiao0Cheng Zhan1Hong Lai2Li Tao3Zhiguo Qu4School of Computer and Information Science, Southwest University, Chongqing, ChinaSchool of Computer and Information Science, Southwest University, Chongqing, ChinaSchool of Computer and Information Science, Southwest University, Chongqing, ChinaSchool of Computer and Information Science, Southwest University, Chongqing, ChinaSchool of Computer & Software, Nanjing University of Information Science & Technology, Nanjing, ChinaSensor network–based application has gained increasing attention where data streams gathered from distributed sensors need to be processed and analyzed with timely responses. Distributed complex event processing is an effective technology to handle these data streams by matching of incoming events to persistent pattern queries. Therefore, a well-managed parallel processing scheme is required to improve both system performance and the quality-of-service guarantees of the system. However, the specific properties of pattern operators increase the difficulties of implementing parallel processing. To address this issue, a new parallelization model and three parallel processing strategies are proposed for distributed complex event processing systems. The effects of temporal constraints, for example, sliding windows, are included in the new parallelization model to enable the processing load for the overlap between windows of a batch induced by each input event to be shared by the downstream machines to avoid events that may result in wrong decisions. The proposed parallel strategies can keep the complex event processing system working stably and continuously during the elapsed time. Finally, the application of our work is demonstrated using experiments on the StreamBase system regardless of the increased input rate of the stream or the increased time window size of the operator.https://doi.org/10.1177/1550147717728626 |
| spellingShingle | Fuyuan Xiao Cheng Zhan Hong Lai Li Tao Zhiguo Qu New parallel processing strategies in complex event processing systems with data streams International Journal of Distributed Sensor Networks |
| title | New parallel processing strategies in complex event processing systems with data streams |
| title_full | New parallel processing strategies in complex event processing systems with data streams |
| title_fullStr | New parallel processing strategies in complex event processing systems with data streams |
| title_full_unstemmed | New parallel processing strategies in complex event processing systems with data streams |
| title_short | New parallel processing strategies in complex event processing systems with data streams |
| title_sort | new parallel processing strategies in complex event processing systems with data streams |
| url | https://doi.org/10.1177/1550147717728626 |
| work_keys_str_mv | AT fuyuanxiao newparallelprocessingstrategiesincomplexeventprocessingsystemswithdatastreams AT chengzhan newparallelprocessingstrategiesincomplexeventprocessingsystemswithdatastreams AT honglai newparallelprocessingstrategiesincomplexeventprocessingsystemswithdatastreams AT litao newparallelprocessingstrategiesincomplexeventprocessingsystemswithdatastreams AT zhiguoqu newparallelprocessingstrategiesincomplexeventprocessingsystemswithdatastreams |