Cargando…

Performance Evaluation Analysis of Spark Streaming Backpressure for Data-Intensive Pipelines

A significant rise in the adoption of streaming applications has changed the decision-making processes in the last decade. This movement has led to the emergence of several Big Data technologies for in-memory processing, such as the systems Apache Storm, Spark, Heron, Samza, Flink, and others. Spark...

Descripción completa

Detalles Bibliográficos
Autores principales:	Matteussi, Kassiano J., dos Anjos, Julio C. S., Leithardt, Valderi R. Q., Geyer, Claudio F. R.
Formato:	Online Artículo Texto
Lenguaje:	English
Publicado:	MDPI 2022
Materias:	Article
Acceso en línea:	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9269592/ https://www.ncbi.nlm.nih.gov/pubmed/35808249 http://dx.doi.org/10.3390/s22134756

Ejemplares similares

An Algorithm to Minimize Energy Consumption and Elapsed Time for IoT Workloads in a Hybrid Architecture
por: dos Anjos, Julio C. S., et al.
Publicado: (2021)

Backpressure Optimization in Foam Injection Molding: Method and Assessment of Sustainability
por: Kastner, Clemens, et al.
Publicado: (2020)

Stream processing with Apache Spark: mastering structured streaming and Spark streaming
por: Maas, Gerard, et al.
Publicado: (2019)

Building of CRAB Spark Data Pipeline
por: Atthaphan, Ek-Ong
Publicado: (2023)

PRISER: Managing Notification in Multiples Devices with Data Privacy Support
por: Silva, Luis Augusto, et al.
Publicado: (2019)

Excess Air Ratio Management in a Diesel Engine with Exhaust Backpressure Compensation
por: Kasprzyk, Piotr, et al.
Publicado: (2020)

Optimised lambda architecture for monitoring WLCG using spark and spark streaming
por: Suthakar, U, et al.
Publicado: (2017)

Cluster equilibrium scheduling method based on backpressure flow control in railway power supply systems
por: Qu, Zhijian, et al.
Publicado: (2020)

Learning real-time processing with Spark Streaming: building scalable and fault-tolerant streaming applications made easy with Spark Streaming
por: Gupta, Sumit
Publicado: (2015)

SparkRA: Enabling Big Data Scalability for the GATK RNA-seq Pipeline with Apache Spark
por: Al-Ars, Zaid, et al.
Publicado: (2020)

An Architecture for Managing Data Privacy in Healthcare with Blockchain
por: de Moraes Rossetto, Anubis Graciela, et al.
Publicado: (2022)

Compatibility optimization of a polyhedral-shape thermoelectric generator for automobile exhaust recovery considering backpressure effects
por: Quan, Rui, et al.
Publicado: (2022)

Streaming data: understanding the real-time pipeline
por: Psaltis, Andrew G
Publicado: (2017)

Simple and Scalable Streaming: The GRETA Data Pipeline
por: Cromaz, Mario
Publicado: (2021)

Pro Spark streaming: the zen of real-time analytics using Apache Spark
por: Nabi, Zubair
Publicado: (2016)

Apache Spark 2: master complex big data processing, stream analytics, and machine learning with Apache Spark
por: Kienzler, Romeo, et al.
Publicado: (2018)

Towards ubiquitous requirements engineering through recommendations based on context histories
por: Lima, Robson, et al.
Publicado: (2022)

Beginning Apache Spark 2: with resilient distributed datasets, Spark SQL, structured streaming and Spark machine learning library
por: Luu, Hien
Publicado: (2018)

Real-time pneumonia prediction using pipelined spark and high-performance computing
por: Ravikumar, Aswathy, et al.
Publicado: (2023)

Reproducible Analysis Pipeline for Data Streams: Open-Source Software to Process Data Collected With Mobile Devices
por: Vega, Julio, et al.
Publicado: (2021)

A new Apache Spark-based framework for big data streaming forecasting in IoT networks
por: Fernández-Gómez, Antonio M., et al.
Publicado: (2023)

Learning Spark SQL: architect streaming analytics and machine learning solutions
por: Sarkar, Aurobindo
Publicado: (2017)

Environmental impact of the explosion of the Nord Stream pipelines
por: Sanderson, Hans, et al.
Publicado: (2023)

Data-intensive systems: principles and fundamentals using Hadoop and Spark
por: Wiktorski, Tomasz
Publicado: (2019)

Real-Time Heart Arrhythmia Detection Using Apache Spark Structured Streaming
por: Ilbeigipour, Sadegh, et al.
Publicado: (2021)

Wavelet LSTM for Fault Forecasting in Electrical Power Grids
por: Branco, Nathielle Waldrigues, et al.
Publicado: (2022)

Rapid development of cloud-native intelligent data pipelines for scientific data streams using the HASTE Toolkit
por: Blamey, Ben, et al.
Publicado: (2021)

Static Attitude Determination Using Convolutional Neural Networks
por: dos Santos, Guilherme Henrique, et al.
Publicado: (2021)

Data Algorithms with Spark
por: Parsian, Mahmoud
Publicado: (2021)

Develop streaming pipelines and analytics solutions for CERN’s IoT Platform
por: Quintero Vallejos, Natacha Andrea
Publicado: (2018)

High performance Spark: best practices for scaling and optimizing Apache Spark
por: Karau, Holden, et al.
Publicado: (2017)

Alignment data streams for the ATLAS inner detector
por: Pinto, B, et al.
Publicado: (2008)

Learning PySpark: build data-intensive applications locally and deploy at scale using the combined powers of Python and Spark 2.0
por: Drabas, Tomasz, et al.
Publicado: (2017)

Scala and Spark for big data analytics: tame big data with Scala and Apache Spark!
por: Karim, Md Rezaul
Publicado: (2017)

Timing performance of spark counters and photon feedback
por: Pestov, Yu N, et al.
Publicado: (2000)

Fault Prediction Based on Leakage Current in Contaminated Insulators Using Enhanced Time Series Forecasting Models
por: Sopelsa Neto, Nemesio Fava, et al.
Publicado: (2022)

Fast data processing with Spark
por: Sankar, Krishna, et al.
Publicado: (2015)

Recursive Data Structures in SPARK
por: Dross, Claire, et al.
Publicado: (2020)

Streaming Support for Data Intensive Cloud-Based Sequence Analysis
por: Issa, Shadi A., et al.
Publicado: (2013)

Performance and simulation of Glass Spark Counter
por: Bencivenni, G, et al.
Publicado: (1996)

Cannot write session to /tmp/vufind_sessions/sess_00v68qsd74cjd0d7l1j4p0olvs