Grand challenge: Automatic anomaly detection over sliding windows

Tarek Zaarour, Niki Pavlopoulou, Souleiman Hasan, Umair Ul Hassan, Edward Curry

Research output: Chapter in Book or Conference Publication/ProceedingConference Publicationpeer-review

6 Citations (Scopus)

Abstract

With the advances in the Internet of Things and rapid generation of vast amounts of data, there is an ever growing need for leveraging and evaluating event-based systems as a basis for building realtime data analytics applications. The ability to detect, analyze, and respond to abnormal patterns of events in a timely manner is as challenging as it is important. For instance, distributed processing environment might affect the required order of events, time-consuming computations might fail to scale, or delays of alarms might lead to unpredicted system behavior. The ACM DEBS Grand Challenge 2017 focuses on real-time anomaly detection for manufacturing equipments based on the observation of a stream of measurements generated by embedded digital and analogue sensors. In this paper, we present our solution to the challenge leveraging the Apache Flink stream processing framework and anomaly ordering based on sliding windows, and evaluate the performance in terms of event latency and throughput.

Original languageEnglish
Title of host publicationDEBS 2017 - Proceedings of the 11th ACM International Conference on Distributed Event-Based Systems
PublisherAssociation for Computing Machinery, Inc
Pages310-314
Number of pages5
ISBN (Electronic)9781450350655
DOIs
Publication statusPublished - 8 Jun 2017
Externally publishedYes
Event11th ACM International Conference on Distributed Event-Based Systems, DEBS 2017 - Barcelona, Spain
Duration: 19 Jun 201723 Jun 2017

Publication series

NameDEBS 2017 - Proceedings of the 11th ACM International Conference on Distributed Event-Based Systems

Conference

Conference11th ACM International Conference on Distributed Event-Based Systems, DEBS 2017
Country/TerritorySpain
CityBarcelona
Period19/06/1723/06/17

Keywords

  • Anomaly detection
  • Event ordering
  • Event-basedprocessing
  • K-means
  • Markov chain model

Fingerprint

Dive into the research topics of 'Grand challenge: Automatic anomaly detection over sliding windows'. Together they form a unique fingerprint.

Cite this