1 research outputs found
A Survey of Benchmarks to Evaluate Data Analytics for Smart-* Applications
The growth of ubiquitous sensor networks at an accelerating pace cuts across
many areas of modern day life. They enable measuring, inferring, understanding
and acting upon a wide variety of indicators, in fields ranging from
agriculture to healthcare or to complex urban environments. The applications
devoted to this task are designated as Smart-* Applications. They hide a
staggering complexity, relying on multiple layers of data collection,
transmission, aggregation, analysis and also storage, both at the network edge
and on the cloud. Furthermore, Smart-* Applications raise additional specific
challenges, such as the need to process and extract knowledge from diverse
data, which is flowing at high velocity in near real-time or in the heavily
distributed environment they rely on. How to assess the performance of such a
complex stack, when faced with the specifics of \mbox{Smart-*} Applications,
remains an open research question. In this article, the key specific
characteristics and requirements of Smart-* Applications are initially
detailed. Afterwards, for each of these requirements, there is a description of
the benchmarks one can use to precisely evaluate the performance of the
underlying systems and technologies. Finally, an identification of future
research directions related to identified open issues for benchmarking Smart-*
Applications is performed