Cargando…

Apache Spark usage and deployment models for scientific computing

This talk is about sharing our recent experiences in providing data analytics platform based on Apache Spark for High Energy Physics, CERN accelerator logging system and infrastructure monitoring. The Hadoop Service has started to expand its user base for researchers who want to perform analysis wit...

Descripción completa

Detalles Bibliográficos
Autores principales:	Castro, Diogo, Kothuri, Prasanth, Mrowczynski, Piotr, Piparo, Danilo, Tejedor, Enric
Lenguaje:	eng
Publicado:	2019
Materias:	Computing and Computers
Acceso en línea:	https://dx.doi.org/10.1051/epjconf/201921407020 http://cds.cern.ch/record/2699480

Ejemplares similares

Hands-on deep learning with Apache Spark: build and deploy distributed deep learning applications on Apache Spark
por: Iozzia, Guglielmo
Publicado: (2019)

Mastering Apache Spark: gain expertise in processing and storing data by using advanced techniques with Apache Spark
por: Frampton, Mike, et al.
Publicado: (2015)

Apache Spark 2.x cookbook: Cloud-ready recipes to do analytics and data science on Apache Spark
por: Yadav, Rishi
Publicado: (2017)

Apache Spark for data science cookbook: overinsightful 90 recipes to get lightning-fast analytics with Apache Spark
por: Chitturi, Padma Priya
Publicado: (2016)

Apache Spark quick start guide: quickly learn the art of writing efficient big data applications with Apache Spark
por: Mehrotra, Shrey, et al.
Publicado: (2019)

Stream processing with Apache Spark: mastering structured streaming and Spark streaming
por: Maas, Gerard, et al.
Publicado: (2019)

High performance Spark: best practices for scaling and optimizing Apache Spark
por: Karau, Holden, et al.
Publicado: (2017)

ScienceBox Converging to Kubernetes containers in production for on-premise and hybrid clouds for CERNBox, SWAN, and EOS
por: Bocchi, Enrico, et al.
Publicado: (2020)

Practical Apache Spark: using the Scala API
por: Chellappan, Subhashini, et al.
Publicado: (2018)

Apache Spark deep learning cookbook: over 80 recipes that streamline deep learning in a distributed environment with Apache Spark
por: Sherif, Ahmed, et al.
Publicado: (2018)

Apache Spark 2.x for Java developers: explore data at scale using the Java APIs of Apache Spark 2.x
por: Gulati, Sourav, et al.
Publicado: (2017)

Pro Spark streaming: the zen of real-time analytics using Apache Spark
por: Nabi, Zubair
Publicado: (2016)

Apache Spark 2.x machine learning cookbook
por: Amirghodsi, Siamak, et al.
Publicado: (2016)

Sams teach yourself Apache Spark in 24 hours
por: Aven, Jeffrey
Publicado: (2017)

Scala and Spark for big data analytics: tame big data with Scala and Apache Spark!
por: Karim, Md Rezaul
Publicado: (2017)

Apache Spark graph processing: build, process, and analyze large-scale graphs with Spark
por: Ramamonjison, Rindra, et al.
Publicado: (2015)

Frank Kane's Taming big data with Apache Spark and Python: real-world examples to help you analyze large datasets with Apache Spark
por: Kane, Frank
Publicado: (2017)

Apache Spark machine learning blueprints: develop a range of cutting-edge machine learning projects with Apache Spark using this actionable guide
por: Liu, Alex
Publicado: (2016)

Big Data Tools and Cloud Services for High Energy Physics Analysis in TOTEM Experiment
por: Avati, Valentina, et al.
Publicado: (2019)

Beginning Apache Spark 2: with resilient distributed datasets, Spark SQL, structured streaming and Spark machine learning library
por: Luu, Hien
Publicado: (2018)

Laurelin: Java-native ROOT I/O for Apache Spark
por: Melo, Andrew, et al.
Publicado: (2021)

Graph algorithms: practical examples in Apache Spark and Neo4j
por: Neam, Mark, et al.
Publicado: (2019)

Learning Apache Spark 2: process big data with the speed of light!
por: Abbasi, Muhammad Asif
Publicado: (2017)

Big data processing with Apache Spark: efficiently tackle large datasets and big data analysis with Spark and Python
por: Franco Galeano, Manuel Ignacio
Publicado: (2018)

CMS Analysis and Data Reduction with Apache Spark
por: Gutsche, Oliver, et al.
Publicado: (2017)

PySpark cookbook: over 60 recipes for implementing big data processing and analytics using Apache Spark and Python
por: Lee, Denny, et al.
Publicado: (2018)

Mastering Apache Spark 2.x: scalable analytics faster than ever
por: Kienzler, Romeo
Publicado: (2017)

Apache Karaf cookbook : over 60 recipes to help you get the most out of Apache Karaf deployments
por: Nierbeck, Achim
Publicado: (2014)

Apache Spark 2 for beginners: develop large-scale distributed data processing applications using Spark 2 in Scala and Python
por: Thottuvaikkatumana, Rajanarayanan
Publicado: (2016)

Facilitating collaborative analysis in SWAN
por: Tejedor, Enric, et al.
Publicado: (2019)

Next-generation big data: a practical guide to Apache Kudu, Impala, and Spark
por: Quinto, Butch
Publicado: (2018)

Practical real-time data processing and analytics: distributed computing and event processing using Apache Spark, Flink, Storm, and Kafka
por: Saxena, Shilpi, et al.
Publicado: (2017)

Random Decision Forests on Apache Spark
por: White, Tom
Publicado: (2016)

Interactive data analysis of data from high energy physics experiments using Apache Spark
por: Blaszkiewicz, Milosz
Publicado: (2019)

Learn Apache Mesos: a beginner's guide to scalable cluster management and deployment
por: Aggarwal, Manuj
Publicado: (2018)

Scala programming for big data analytics: get started with big data analytics using Apache Spark
por: Elahi, Irfan
Publicado: (2019)

Building data streaming applications with Apache Kafka: designing and deploying enterprise messaging queues
por: Kumar, Manish, et al.
Publicado: (2017)

Apache Cxf web service development: develop and deploy SOAP and RESTful web services
por: Balani, Naveen
Publicado: (2009)

LCG-1 Deployment and usage experience
por: Shamardin, L V
Publicado: (2003)

Web-Based Analysis at CERN
por: Castro, Diogo, et al.
Publicado: (2021)

Cannot write session to /tmp/vufind_sessions/sess_b9451ah7ld0ial4rargh0si2sj