Cargando…

A Serverless Engine for High Energy Physics Distributed Analysis

The Large Hadron Collider (LHC) at CERN has generated in the last decade an unprecedented volume of data for the High-Energy Physics (HEP) field. Scientific collaborations interested in analysing such data very often require computing power beyond a single machine. This issue has been tackled tradit...

Descripción completa

Detalles Bibliográficos
Autores principales:	Kuśnierz, Jacek, Padulano, Vincenzo Eduardo, Malawski, Maciej, Burkiewicz, Kamil, Saavedra, Enric Tejedor, Alonso-Jordá, Pedro, Pitt, Michael, Avati, Valentina
Lenguaje:	eng
Publicado:	2022
Materias:	cs.DC Computing and Computers
Acceso en línea:	https://dx.doi.org/10.1109/CCGrid54584.2022.00067 http://cds.cern.ch/record/2815205

Ejemplares similares

Micro-CernVM: Slashing the Cost of Building and Deploying Virtual Machines
por: Blomer, J., et al.
Publicado: (2014)

Increasing Parallelism in the ROOT I/O Subsystem
por: Amadio, Guilherme, et al.
Publicado: (2018)

Using Big Data Technologies for HEP Analysis
por: Cremonesi, Matteo, et al.
Publicado: (2019)

GRID Storage Optimization in Transparent and User-Friendly Way for LHCb Datasets
por: Hushchyn, Mikhail, et al.
Publicado: (2017)

Big Data in HEP: A comprehensive use case study
por: Gutsche, Oliver, et al.
Publicado: (2017)

Provenance tracking in the LHCb software
por: Trisovic, Ana, et al.
Publicado: (2020)

CMS Analysis and Data Reduction with Apache Spark
por: Gutsche, Oliver, et al.
Publicado: (2017)

Third-party transfers in WLCG using HTTP
por: Bockelman, Brian, et al.
Publicado: (2020)

C++ Modules in ROOT and Beyond
por: Vassilev, Vassil, et al.
Publicado: (2020)

Migration of CMSWEB Cluster at CERN to Kubernetes
por: Imran, Muhammad, et al.
Publicado: (2021)

Simulation and Evaluation of Cloud Storage Caching for Data Intensive Science
por: Wegner, Tobias, et al.
Publicado: (2022)

Prototyping a ROOT-based distributed analysis workflow for HL-LHC: the CMS use case
por: Tedeschi, Tommaso, et al.
Publicado: (2023)

Scalable Global Grid catalogue for LHC Run3 and beyond
por: Martinez Pedreira, Miguel, et al.
Publicado: (2017)

WLCG Authorisation from X.509 to Tokens
por: Bockelman, Brian, et al.
Publicado: (2020)

Fine-grained data caching approaches to speedup a distributed RDataFrame analysis
por: Padulano, Vincenzo Eduardo, et al.
Publicado: (2021)

Leveraging State-of-the-Art Engines for Large-Scale Data Analysis in High Energy Physics
por: Padulano, Vincenzo Eduardo, et al.
Publicado: (2023)

Arhuaco: Deep Learning and Isolation Based Security for Distributed High-Throughput Computing
por: Gomez Ramirez, A., et al.
Publicado: (2018)

Distributed data analysis with ROOT RDataFrame
por: Padulano, Vincenzo Eduardo, et al.
Publicado: (2020)

A caching mechanism to exploit object store speed in High Energy Physics analysis
por: Padulano, Vincenzo Eduardo, et al.
Publicado: (2022)

LHCb trigger streams optimization
por: Derkach, D., et al.
Publicado: (2017)

Addressing Scalability with Message Queues: Architecture and Use Cases for DIRAC Interware
por: Krzemien, Wojciech, et al.
Publicado: (2019)

Dynamo: Handling Scientific Data Across Sites and Storage Media
por: Iiyama, Yutaro, et al.
Publicado: (2020)

The ATLAS EventIndex: a BigData catalogue for all ATLAS experiment events
por: Barberis, Dario, et al.
Publicado: (2022)

Distributed statistical inference with pyhf enabled through funcX
por: Feickert, Matthew, et al.
Publicado: (2021)

Machine Learning Pipelines with Modern Big Data Tools for High Energy Physics
por: Migliorini, Matteo, et al.
Publicado: (2019)

A Security Monitoring Framework For Virtualization Based HEP Infrastructures
por: Gomez Ramirez, A., et al.
Publicado: (2017)

Serverless architectures with AWS
por: Gupta, Mohit
Publicado: (2018)

Building serverless architectures
por: Gurturk, Cagatay
Publicado: (2017)

Serverless programming cookbook: practical solutions to building serverless applications using Java and AWS
por: Kanikathottu, Heartin
Publicado: (2019)

HEPCloud, a New Paradigm for HEP Facilities: CMS Amazon Web Services Investigation
por: Holzman, Burt, et al.
Publicado: (2017)

Astronomical data organization, management and access in Scientific Data Lakes
por: Grange, Y.G., et al.
Publicado: (2022)

Building serverless web applications: build scalable web apps using Serverless Framework on AWS
por: Zanon, Diego
Publicado: (2017)

Building serverless Python web services with Zappa: build and deploy serverless applications on AWS using Zappa
por: Barguzar, Abdulwahid Abdulhaque
Publicado: (2018)

Advanced serverless architectures with Microsoft Azure: design complex serverless systems quickly with the scalability and benefits of Azure
por: Bass, Daniel
Publicado: (2019)

Azure serverless computing cookbook: build and monitor Azure applications hosted on serverless architecture using Azure functions
por: Sreeram, Praveen Kumar
Publicado: (2018)

DevOps for serverless applications: design, deploy, and monitor your serverless applications using DevOps practices
por: Bangera, Shashikant
Publicado: (2018)

Kubernetes for serverless applications: implement FaaS by effectively deploying, managing, monitoring, and orchestrating serverless applications using Kubernetes
por: McKendrick, Russ
Publicado: (2018)

Building serverless microservices in Python: a complete guide to building, testing, and deploying microservices using serverless computing on AWS
por: Freeman, Richard Takashi
Publicado: (2019)

Towards a serverless CernVM-FS
por: Blomer, Jakob, et al.
Publicado: (2019)

Hands-on serverless deep learning with TensorFlow and AWS Lambda: training serverless deep learning models using AWS infrastructure
por: Feyzkhanov, Rustem
Publicado: (2019)

Cannot write session to /tmp/vufind_sessions/sess_0js0vs0sn2mjc8jdnhm219tmsd