Scaling up ATLAS Event Service to production levels on opportunistic computing platforms

Mostrar otras versiones (1)

Continued growth in public cloud and HPC resources is on track to exceed the dedicated resources available for ATLAS on the WLCG. Examples of such platforms are Amazon AWS EC2 Spot Instances, Edison Cray XC30 supercomputer, backfill at Tier 2 and Tier 3 sites, opportunistic resources at the Open Sci...

Descripción completa

Detalles Bibliográficos
Autores principales: Benjamin, Douglas, Caballero, Jose, Ernst, Michael, Guan, Wen, Hover, John, Lesny, David, Maeno, Tadashi, Nilsson, Paul, Tsulaia, Vakhtang, van Gemmeren, Peter, Vaniachine, Alexandre, Wang, Fuquan, Wenaus, Torre
Lenguaje:eng
Publicado: 2016
Materias:
Computing and Computers
Acceso en línea:https://dx.doi.org/10.1088/1742-6596/762/1/012027
http://cds.cern.ch/record/2133923
Descripción
Sumario:Continued growth in public cloud and HPC resources is on track to exceed the dedicated resources available for ATLAS on the WLCG. Examples of such platforms are Amazon AWS EC2 Spot Instances, Edison Cray XC30 supercomputer, backfill at Tier 2 and Tier 3 sites, opportunistic resources at the Open Science Grid (OSG), and ATLAS High Level Trigger farm between the data taking periods. Because of specific aspects of opportunistic resources such as preemptive job scheduling and data I/O, their efficient usage requires workflow innovations provided by the ATLAS Event Service. Thanks to the finer granularity of the Event Service data processing workflow, the opportunistic resources are used more efficiently. We report on our progress in scaling opportunistic resource usage to double-digit levels in ATLAS production.

Ejemplares similares