Cargando…

Fine-Grained Processing Towards HL-LHC Computing in ATLAS

During LHC's Run-2 ATLAS has been developing and evaluating new fine-grained approaches to workflows and dataflows able to better utilize computing resources in terms of storage, processing and networks. The compute-limited physics of ATLAS has driven the collaboration to aggressively harvest o...

Descripción completa

Detalles Bibliográficos
Autores principales: Benjamin, Doug, Calafiura, Paolo, Childers, Taylor, De, Kaushik, Di Girolamo, Alessandro, Fullana, Esteban, Guan, Wen, Maeno, Tadashi, Magini, Nicolo, Nilsson, Paul, Oleynik, Danila, Sun, Shaojun, Tsulaia, Vakho, Van Gemmeren, Peter, Wenaus, Torre, Yang, Wei
Lenguaje:eng
Publicado: 2018
Materias:
Acceso en línea:https://dx.doi.org/10.1109/eScience.2018.00083
http://cds.cern.ch/record/2674724
_version_ 1780962631147847680
author Benjamin, Doug
Calafiura, Paolo
Childers, Taylor
De, Kaushik
Di Girolamo, Alessandro
Fullana, Esteban
Guan, Wen
Maeno, Tadashi
Magini, Nicolo
Nilsson, Paul
Oleynik, Danila
Sun, Shaojun
Tsulaia, Vakho
Van Gemmeren, Peter
Wenaus, Torre
Yang, Wei
author_facet Benjamin, Doug
Calafiura, Paolo
Childers, Taylor
De, Kaushik
Di Girolamo, Alessandro
Fullana, Esteban
Guan, Wen
Maeno, Tadashi
Magini, Nicolo
Nilsson, Paul
Oleynik, Danila
Sun, Shaojun
Tsulaia, Vakho
Van Gemmeren, Peter
Wenaus, Torre
Yang, Wei
author_sort Benjamin, Doug
collection CERN
description During LHC's Run-2 ATLAS has been developing and evaluating new fine-grained approaches to workflows and dataflows able to better utilize computing resources in terms of storage, processing and networks. The compute-limited physics of ATLAS has driven the collaboration to aggressively harvest opportunistic cycles from what are often transiently available resources, including HPCs, clouds, volunteer computing, and grid resources in transitional states. Fine-grained processing (with typically a few minutes' granularity, corresponding to one event for the present ATLAS full simulation) enables agile workflows with a light footprint on the resource such that cycles can be more fully and efficiently utilized than with conventional workflows processing O(GB) files per job.
id oai-inspirehep.net-1721169
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2018
record_format invenio
spelling oai-inspirehep.net-17211692019-09-30T06:29:59Zdoi:10.1109/eScience.2018.00083http://cds.cern.ch/record/2674724engBenjamin, DougCalafiura, PaoloChilders, TaylorDe, KaushikDi Girolamo, AlessandroFullana, EstebanGuan, WenMaeno, TadashiMagini, NicoloNilsson, PaulOleynik, DanilaSun, ShaojunTsulaia, VakhoVan Gemmeren, PeterWenaus, TorreYang, WeiFine-Grained Processing Towards HL-LHC Computing in ATLASComputing and ComputersDetectors and Experimental TechniquesDuring LHC's Run-2 ATLAS has been developing and evaluating new fine-grained approaches to workflows and dataflows able to better utilize computing resources in terms of storage, processing and networks. The compute-limited physics of ATLAS has driven the collaboration to aggressively harvest opportunistic cycles from what are often transiently available resources, including HPCs, clouds, volunteer computing, and grid resources in transitional states. Fine-grained processing (with typically a few minutes' granularity, corresponding to one event for the present ATLAS full simulation) enables agile workflows with a light footprint on the resource such that cycles can be more fully and efficiently utilized than with conventional workflows processing O(GB) files per job.oai:inspirehep.net:17211692018
spellingShingle Computing and Computers
Detectors and Experimental Techniques
Benjamin, Doug
Calafiura, Paolo
Childers, Taylor
De, Kaushik
Di Girolamo, Alessandro
Fullana, Esteban
Guan, Wen
Maeno, Tadashi
Magini, Nicolo
Nilsson, Paul
Oleynik, Danila
Sun, Shaojun
Tsulaia, Vakho
Van Gemmeren, Peter
Wenaus, Torre
Yang, Wei
Fine-Grained Processing Towards HL-LHC Computing in ATLAS
title Fine-Grained Processing Towards HL-LHC Computing in ATLAS
title_full Fine-Grained Processing Towards HL-LHC Computing in ATLAS
title_fullStr Fine-Grained Processing Towards HL-LHC Computing in ATLAS
title_full_unstemmed Fine-Grained Processing Towards HL-LHC Computing in ATLAS
title_short Fine-Grained Processing Towards HL-LHC Computing in ATLAS
title_sort fine-grained processing towards hl-lhc computing in atlas
topic Computing and Computers
Detectors and Experimental Techniques
url https://dx.doi.org/10.1109/eScience.2018.00083
http://cds.cern.ch/record/2674724
work_keys_str_mv AT benjamindoug finegrainedprocessingtowardshllhccomputinginatlas
AT calafiurapaolo finegrainedprocessingtowardshllhccomputinginatlas
AT childerstaylor finegrainedprocessingtowardshllhccomputinginatlas
AT dekaushik finegrainedprocessingtowardshllhccomputinginatlas
AT digirolamoalessandro finegrainedprocessingtowardshllhccomputinginatlas
AT fullanaesteban finegrainedprocessingtowardshllhccomputinginatlas
AT guanwen finegrainedprocessingtowardshllhccomputinginatlas
AT maenotadashi finegrainedprocessingtowardshllhccomputinginatlas
AT magininicolo finegrainedprocessingtowardshllhccomputinginatlas
AT nilssonpaul finegrainedprocessingtowardshllhccomputinginatlas
AT oleynikdanila finegrainedprocessingtowardshllhccomputinginatlas
AT sunshaojun finegrainedprocessingtowardshllhccomputinginatlas
AT tsulaiavakho finegrainedprocessingtowardshllhccomputinginatlas
AT vangemmerenpeter finegrainedprocessingtowardshllhccomputinginatlas
AT wenaustorre finegrainedprocessingtowardshllhccomputinginatlas
AT yangwei finegrainedprocessingtowardshllhccomputinginatlas