Cargando…

CMS Analysis and Data Reduction with Apache Spark

Experimental Particle Physics has been at the forefront of analyzing the world's largest datasets for decades. The HEP community was among the first to develop suitable software and computing tools for this task. In recent times, new toolkits and systems for distributed data processing, collect...

Descripción completa

Detalles Bibliográficos
Autores principales:	Gutsche, Oliver, Canali, Luca, Cremer, Illia, Cremonesi, Matteo, Elmer, Peter, Fisk, Ian, Girone, Maria, Jayatilaka, Bo, Kowalkowski, Jim, Khristenko, Viktor, Motesnitsalis, Evangelos, Pivarski, Jim, Sehrish, Saba, Surdy, Kacper, Svyatkovskiy, Alexey
Lenguaje:	eng
Publicado:	2017
Materias:	cs.DC Computing and Computers
Acceso en línea:	https://dx.doi.org/10.1088/1742-6596/1085/4/042030 http://cds.cern.ch/record/2291606

Ejemplares similares

Big Data in HEP: A comprehensive use case study
por: Gutsche, Oliver, et al.
Publicado: (2017)

Using Big Data Technologies for HEP Analysis
por: Cremonesi, Matteo, et al.
Publicado: (2019)

Micro-CernVM: Slashing the Cost of Building and Deploying Virtual Machines
por: Blomer, J., et al.
Publicado: (2014)

GRID Storage Optimization in Transparent and User-Friendly Way for LHCb Datasets
por: Hushchyn, Mikhail, et al.
Publicado: (2017)

Provenance tracking in the LHCb software
por: Trisovic, Ana, et al.
Publicado: (2020)

Increasing Parallelism in the ROOT I/O Subsystem
por: Amadio, Guilherme, et al.
Publicado: (2018)

Third-party transfers in WLCG using HTTP
por: Bockelman, Brian, et al.
Publicado: (2020)

C++ Modules in ROOT and Beyond
por: Vassilev, Vassil, et al.
Publicado: (2020)

Migration of CMSWEB Cluster at CERN to Kubernetes
por: Imran, Muhammad, et al.
Publicado: (2021)

Simulation and Evaluation of Cloud Storage Caching for Data Intensive Science
por: Wegner, Tobias, et al.
Publicado: (2022)

A Serverless Engine for High Energy Physics Distributed Analysis
por: Kuśnierz, Jacek, et al.
Publicado: (2022)

Scalable Global Grid catalogue for LHC Run3 and beyond
por: Martinez Pedreira, Miguel, et al.
Publicado: (2017)

WLCG Authorisation from X.509 to Tokens
por: Bockelman, Brian, et al.
Publicado: (2020)

Apache Flink: Distributed Stream Data Processing
por: Jacobs, Kevin, et al.
Publicado: (2016)

Arhuaco: Deep Learning and Isolation Based Security for Distributed High-Throughput Computing
por: Gomez Ramirez, A., et al.
Publicado: (2018)

Machine Learning Pipelines with Modern Big Data Tools for High Energy Physics
por: Migliorini, Matteo, et al.
Publicado: (2019)

HEPCloud, a New Paradigm for HEP Facilities: CMS Amazon Web Services Investigation
por: Holzman, Burt, et al.
Publicado: (2017)

Mastering Apache Spark: gain expertise in processing and storing data by using advanced techniques with Apache Spark
por: Frampton, Mike, et al.
Publicado: (2015)

Hands-on deep learning with Apache Spark: build and deploy distributed deep learning applications on Apache Spark
por: Iozzia, Guglielmo
Publicado: (2019)

The ATLAS EventIndex: a BigData catalogue for all ATLAS experiment events
por: Barberis, Dario, et al.
Publicado: (2022)

Apache Spark 2.x cookbook: Cloud-ready recipes to do analytics and data science on Apache Spark
por: Yadav, Rishi
Publicado: (2017)

Apache Spark for data science cookbook: overinsightful 90 recipes to get lightning-fast analytics with Apache Spark
por: Chitturi, Padma Priya
Publicado: (2016)

Apache Spark quick start guide: quickly learn the art of writing efficient big data applications with Apache Spark
por: Mehrotra, Shrey, et al.
Publicado: (2019)

Stream processing with Apache Spark: mastering structured streaming and Spark streaming
por: Maas, Gerard, et al.
Publicado: (2019)

High performance Spark: best practices for scaling and optimizing Apache Spark
por: Karau, Holden, et al.
Publicado: (2017)

Practical Apache Spark: using the Scala API
por: Chellappan, Subhashini, et al.
Publicado: (2018)

Apache Spark deep learning cookbook: over 80 recipes that streamline deep learning in a distributed environment with Apache Spark
por: Sherif, Ahmed, et al.
Publicado: (2018)

Apache Spark 2.x for Java developers: explore data at scale using the Java APIs of Apache Spark 2.x
por: Gulati, Sourav, et al.
Publicado: (2017)

Pro Spark streaming: the zen of real-time analytics using Apache Spark
por: Nabi, Zubair
Publicado: (2016)

Apache Spark 2.x machine learning cookbook
por: Amirghodsi, Siamak, et al.
Publicado: (2016)

Sams teach yourself Apache Spark in 24 hours
por: Aven, Jeffrey
Publicado: (2017)

Apache Spark usage and deployment models for scientific computing
por: Castro, Diogo, et al.
Publicado: (2019)

Scala and Spark for big data analytics: tame big data with Scala and Apache Spark!
por: Karim, Md Rezaul
Publicado: (2017)

Apache Spark graph processing: build, process, and analyze large-scale graphs with Spark
por: Ramamonjison, Rindra, et al.
Publicado: (2015)

Frank Kane's Taming big data with Apache Spark and Python: real-world examples to help you analyze large datasets with Apache Spark
por: Kane, Frank
Publicado: (2017)

Apache Spark machine learning blueprints: develop a range of cutting-edge machine learning projects with Apache Spark using this actionable guide
por: Liu, Alex
Publicado: (2016)

LHCb trigger streams optimization
por: Derkach, D., et al.
Publicado: (2017)

Addressing Scalability with Message Queues: Architecture and Use Cases for DIRAC Interware
por: Krzemien, Wojciech, et al.
Publicado: (2019)

Dynamo: Handling Scientific Data Across Sites and Storage Media
por: Iiyama, Yutaro, et al.
Publicado: (2020)

Distributed statistical inference with pyhf enabled through funcX
por: Feickert, Matthew, et al.
Publicado: (2021)

Cannot write session to /tmp/vufind_sessions/sess_et325sdv62eo3vfttndjcoet9t