TY - GEN
T1 - CityBench
T2 - 14th International Semantic Web Conference, ISWC 2015
AU - Ali, Muhammad Intizar
AU - Gao, Feng
AU - Mileo, Alessandra
N1 - Publisher Copyright:
© Springer International Publishing Switzerland 2015
PY - 2015
Y1 - 2015
N2 - With the growing popularity of Internet of Things (IoT) and IoT-enabled smart city applications, RDF stream processing (RSP) is gaining increasing attention in the Semantic Web community. As a result, several RSP engines have emerged, which are capable of processing semantically annotated data streams on the fly. Performance, correctness and technical soundness of few existing RSP engines have been evaluated in controlled settings using existing benchmarks like LSBench and SRBench. However, these benchmarks focus merely on features of the RSP query languages and engines, and do not consider dynamic application requirements and data-dependent properties such as changes in streaming rate during query execution or changes in application requirements over a period of time. This hinders wide adoption of RSP engines for real-time applications where data properties and application requirements play a key role and need to be characterised in their dynamic setting, such as in the smart city domain. In this paper, we present CityBench, a comprehensive benchmarking suite to evaluate RSP engines within smart city applications and with smart city data. CityBench includes real-time IoT data streams generated from various sensors deployed within the city of Aarhus, Denmark. We provide a configurable testing infrastructure and a set of continuous queries covering a variety of data- and application- dependent characteristics and performance metrics, to be executed over RSP engines using CityBench datasets. We evaluate two state of the art RSP engines using our testbed and discuss our experimental results. This work can be used as a baseline to identify capabilities and limitations of existing RSP engines for smart city applications.
AB - With the growing popularity of Internet of Things (IoT) and IoT-enabled smart city applications, RDF stream processing (RSP) is gaining increasing attention in the Semantic Web community. As a result, several RSP engines have emerged, which are capable of processing semantically annotated data streams on the fly. Performance, correctness and technical soundness of few existing RSP engines have been evaluated in controlled settings using existing benchmarks like LSBench and SRBench. However, these benchmarks focus merely on features of the RSP query languages and engines, and do not consider dynamic application requirements and data-dependent properties such as changes in streaming rate during query execution or changes in application requirements over a period of time. This hinders wide adoption of RSP engines for real-time applications where data properties and application requirements play a key role and need to be characterised in their dynamic setting, such as in the smart city domain. In this paper, we present CityBench, a comprehensive benchmarking suite to evaluate RSP engines within smart city applications and with smart city data. CityBench includes real-time IoT data streams generated from various sensors deployed within the city of Aarhus, Denmark. We provide a configurable testing infrastructure and a set of continuous queries covering a variety of data- and application- dependent characteristics and performance metrics, to be executed over RSP engines using CityBench datasets. We evaluate two state of the art RSP engines using our testbed and discuss our experimental results. This work can be used as a baseline to identify capabilities and limitations of existing RSP engines for smart city applications.
UR - https://www.scopus.com/pages/publications/84952645854
U2 - 10.1007/978-3-319-25010-6_25
DO - 10.1007/978-3-319-25010-6_25
M3 - Conference Publication
SN - 9783319250090
T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
SP - 374
EP - 389
BT - The Semantic Web – ISWC 2015 - 14th International Semantic Web Conference, Proceedings
A2 - Arenas, Marcelo
A2 - Corcho, Oscar
A2 - Simperl, Elena
A2 - Strohmaier, Markus
A2 - d’Aquin, Mathieu
A2 - Srinivas, Kavitha
A2 - Groth, Paul
A2 - Dumontier, Michel
A2 - Heflin, Jeff
A2 - Thirunarayan, Krishnaprasad
A2 - Staab, Steffen
PB - Springer-Verlag
Y2 - 11 October 2015 through 15 October 2015
ER -