Cargando…

Building and using containers at HPC centres for the ATLAS experiment

The HPC environment presents several challenges to the ATLAS experiment in running their automated computational workflows smoothly and efficiently, in particular regarding issues such as software distribution and I/O load. A vital component of the LHC Computing Grid, CVMFS, is not always available...

Descripción completa

Detalles Bibliográficos
Autores principales:	Benjamin, Douglas, Childers, Taylor, Lesny, David, Oleynik, Danila, Panitkin, Sergey, Tsulaia, Vakho, Yang, Wei, Zhao, Xin
Lenguaje:	eng
Publicado:	EDP Sciences 2019
Materias:	Computing and Computers Particle Physics - Experiment
Acceso en línea:	https://dx.doi.org/10.1051/epjconf/201921407005 http://cds.cern.ch/record/2728398

Ejemplares similares

Building and Using Containers on HPCs for the ATLAS Experiment
por: Yang, Wei, et al.
Publicado: (2018)

Using Containers on HPCs for ATLAS Experiment
por: Benjamin, Douglas, et al.
Publicado: (2018)

Large scale fine grain simulation workflows ("Jumbo Jobs") on HPC's
por: Benjamin, Douglas, et al.
Publicado: (2019)

Fine-Grained Processing Towards HL-LHC Computing in ATLAS
por: Benjamin, Doug, et al.
Publicado: (2018)

The ATLAS Event Service: A New Approach to Event Processing
por: Calafiura, Paolo, et al.
Publicado: (2015)

GPU Usage in ATLAS Reconstruction and Analysis
por: Krasznahorkay, Attila, et al.
Publicado: (2020)

Raythena: a vertically integrated scheduler for ATLAS applications on heterogeneous distributed resources
por: Muškinja, Miha, et al.
Publicado: (2020)

Integration of the Chinese HPC Grid in ATLAS Distributed Computing
por: Filipcic, Andrej
Publicado: (2017)

Optimizing new components of PanDA for ATLAS production on HPC resources
por: Maeno, Tadashi, et al.
Publicado: (2017)

HPC Virtualization with Xen on Itanium
por: Bjerke, Håvard K F
Publicado: (2005)

Enabling HPC systems for HEP: the INFN-CINECA Experience
por: Boccali, Tommaso, et al.
Publicado: (2021)

BigPanDA Experience on LCF and HPC for the ATLAS Experiment at the LHC and data intensive science
por: De, Kaushik, et al.
Publicado: (2018)

HPC in a HEP lab: lessons learned from setting up cost-effective HPC clusters
por: Husejko, Michal, et al.
Publicado: (2015)

Scaling up ATLAS Event Service to production levels on opportunistic computing platforms
por: Benjamin, Douglas, et al.
Publicado: (2016)

HPC File Server Monitoring and Tuning
por: Andresen, Rune Johan
Publicado: (2005)

Delivering LHC software to HPC compute elements
por: Blomer, Jakob, et al.
Publicado: (2017)

Future trends of HPC in a disruptive scenario
por: Grandinetti, L, et al.
Publicado: (2019)

Optimizing HPC applications with Intel cluster tools
por: Supalov, Alexander, et al.
Publicado: (2014)

CMS use of allocation based HPC resources
por: Hufnagel, Dirk
Publicado: (2017)

Exploitation of HPC Resources for data intensive sciences
por: Girone, Maria, et al.
Publicado: (2021)

Leveraging HPC resources with distributed RDataFrame
por: Padulano, V E, et al.
Publicado: (2023)

Integration Of PanDA Workload Management System With Supercomputers for ATLAS and Data Intensive Science
por: Klimentov, A, et al.
Publicado: (2016)

Self-service for software development projects and HPC activities
por: Husejko, Michal, et al.
Publicado: (2014)

Integrating HPC into an agile and cloud-focused environment at CERN
por: Llopis, Pablo, et al.
Publicado: (2019)

Extending the distributed computing infrastructure of the CMS experiment with HPC resources
por: Adelman-McCarthy, J, et al.
Publicado: (2023)

An I/O Analysis of HPC Workloads on CephFS and Lustre
por: Chiusole, Alberto, et al.
Publicado: (2019)

Dynamic scheduling of virtual machines running hpc workloads in scientific grids
por: Khalid, Omer, et al.
Publicado: (2010)

Migrating Engineering Windows HPC applications to Linux HTCondor and Slurm Clusters
por: Alandes Pradillo, Maria, et al.
Publicado: (2020)

Data-Parallel Training of Generative Adversarial Networks on HPC Systems for HEP Simulations
por: Vallecorsa, Sofia, et al.
Publicado: (2018)

The future of distributed computing systems in ATLAS: Boldly venturing beyond grids
por: Barreiro Megino, Fernando Harald, et al.
Publicado: (2018)

Using HPC for computational fluid dynamics: a guide to high performance computing for CFD engineers
por: Jamshed, Shamoon
Publicado: (2015)

Enabling and Optimizing Pilot Jobs using Xen based Virtual Machines for the HPC Grid Applications
por: Khalid, O, et al.
Publicado: (2009)

Enabling and Optimizing Pilot Jobs using Xen based Virtual Machines for the HPC Grid Applications
por: Khalid, Omer, et al.
Publicado: (2009)

Dynamic Distribution of High-Rate Data Processing from CERN to Remote HPC Data Centers
por: Boccali, T, et al.
Publicado: (2021)

Low latency network and distributed storage for next generation HPC systems: the ExaNeSt project
por: Ammendola, R, et al.
Publicado: (2017)

Large-scale HPC deployment of Scalable CyberInfrastructure for Artificial Intelligence and Likelihood Free Inference (SCAILFIN)
por: Hildreth, Michael, et al.
Publicado: (2020)

Evolution of the ATLAS Nightly Build System
por: Undrus, A
Publicado: (2012)

CMS strategy for HPC resource exploitation
por: Perez-Calero Yzquierdo, Antonio Maria
Publicado: (2020)

Docker containers: build and deploy with Kubernetes, Flannel, Cockpit, and Atomic
por: Negus, Chris, et al.
Publicado: (2016)

Sync and Share Access to HPC Resources at CERN
por: Mouratidis, Theofilos, et al.
Publicado: (2022)

Cannot write session to /tmp/vufind_sessions/sess_gohrplcuooe43batjj45htgn27