DABS-Storm: A Data-Aware Approach for Elastic Stream Processing

Roland Kotto-Kombi 1 Nicolas Lumineau 1 Philippe Lamarre 1 Nicoló Rivetti 2, 3, 4 Yann Busnel 5, 6, 7
1 BD - Base de Données
LIRIS - Laboratoire d'InfoRmatique en Image et Systèmes d'information
2 MIDLAB - Middleware Laboratory
3 LINA - Laboratoire d'Informatique de Nantes Atlantique
4 Technion - Israel Institute of Technology [Haifa]
5 IMT Atlantique - IMT Atlantique Bretagne-Pays de la Loire
6 IMT Atlantique - SRCD - Département Systèmes Réseaux, Cybersécurité et Droit du numérique
7 DIONYSOS - Dependability Interoperability and perfOrmance aNalYsiS Of networkS
Inria Rennes – Bretagne Atlantique , IRISA_D2 - RÉSEAUX, TÉLÉCOMMUNICATION ET SERVICES
Abstract : In the last decade, stream processing has become a very active research domain motivated by the growing number of stream-based applications. These applications make use of continuous queries, which are processed by a stream processing engine (SPE) to generate timely results given the ephemeral input data. Variations of input data streams, in terms of both volume and distribution of values, have a large impact on computational resource requirements. Dynamic and Automatic Balanced Scaling for Storm (DABS-Storm) is an original solution for handling dynamic adaptation of continuous queries processing according to evolution of input stream properties, while controlling the system stability. Both fluctuations in data volume and distribution of values within data streams are handled by DABS-Storm to adjust the resources usage that best meets processing needs. To achieve this goal, the DABS-Storm holistic approach combines a proactive auto-parallelization algorithm with a latency-aware load balancing strategy.
Type de document :
Article dans une revue
Transactions on Large-Scale Data- and Knowledge-Centered Systems, Springer Berlin / Heidelberg, 2019, 40, pp.58--93. 〈10.1007/978-3-662-58664-8_3〉
Liste complète des métadonnées
https://hal-imt-atlantique.archives-ouvertes.fr/hal-01951682
Contributeur : Yann Busnel <>
Soumis le : mardi 11 décembre 2018 - 15:41:14
Dernière modification le : mercredi 6 mars 2019 - 15:10:54
Document(s) archivé(s) le : mardi 12 mars 2019 - 15:08:08

Fichier

AS-OSG.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

Collections

IMT-ATLANTIQUE | EC-LYON | LINA | UNIV-RENNES1 | CENTRALESUPELEC | UNIV-LYON1 | IRISA | INSA-LYON | INRIA | UNIV-NANTES | LIRIS | UNIV-RENNES | LYON2 | INSA-GROUPE | UR1-UFR-ISTIC | LABEXIMU

Citation

Roland Kotto-Kombi, Nicolas Lumineau, Philippe Lamarre, Nicoló Rivetti, Yann Busnel. DABS-Storm: A Data-Aware Approach for Elastic Stream Processing. Transactions on Large-Scale Data- and Knowledge-Centered Systems, Springer Berlin / Heidelberg, 2019, 40, pp.58--93. 〈10.1007/978-3-662-58664-8_3〉. 〈hal-01951682〉

Exporter

BibTeX TEI DC DCterms EndNote

Partager

Métriques

Consultations de la notice

315

Téléchargements de fichiers

129

Contact

support.ccsd.cnrs.fr
hal.support@ccsd.cnrs.fr
Logo CCSD