Cargando…

Scalable Declarative HEP Analysis Workflows for Containerised Compute Clouds

Mostrar otras versiones (1)

We describe a novel approach for experimental High-Energy Physics (HEP) data analyses that is centred around the declarative rather than imperative paradigm when describing analysis computational tasks. The analysis process can be structured in the form of a Directed Acyclic Graph (DAG), where each...

Descripción completa

Detalles Bibliográficos
Autores principales:	Šimko, Tibor, Heinrich, Lukas Alexander, Lange, Clemens, Lintuluoto, Adelina Eleonora, MacDonell, Danika Marina, Mečionis, Audrius, Rodríguez Rodríguez, Diego, Shandilya, Parth, Vidal García, Marco
Lenguaje:	eng
Publicado:	2021
Materias:	Computing and Computers
Acceso en línea:	https://dx.doi.org/10.3389/fdata.2021.661501 http://cds.cern.ch/record/2773276

Ejemplares similares

Scalable Declarative HEP Analysis Workflows for Containerised Compute Clouds
por: Šimko, Tibor, et al.
Publicado: (2021)

Scalable cloud ops with Fugue: declare, deploy, and automate the cloud
por: Stella, Josha
Publicado: (2017)

Serverless Workflows for Containerised Applications in the Cloud Continuum
por: Risco, Sebastián, et al.
Publicado: (2021)

Data-intensive workflow management: for clouds and data-intensive and scalable computing environments
por: de Oliveira, Daniel C M, et al.
Publicado: (2019)

Benchmarking cloud resources for HEP
por: Alef, M, et al.
Publicado: (2017)

Simulating Diverse HEP Workflows on Heterogeneous Architectures
por: Leggett, Charles, et al.
Publicado: (2020)

Search for computational workflow synergies in reproducible research data analyses in particle physics and life sciences
por: Šimko, Tibor, et al.
Publicado: (2018)

Support for HTCondor high-throughput computing workflows in the REANA reusable analysis platform
por: Maciulaitis, Rokas, et al.
Publicado: (2019)

Data intensive ATLAS workﬂows in the Cloud
por: Rzehorz, Gerhard Ferdinand
Publicado: (2018)

Cloud broker and cloudlet for workflow scheduling
por: Youn, Chan-Hyun, et al.
Publicado: (2017)

Evaluating the scalability of HEP software and multi-core hardware
por: Jarp, S, et al.
Publicado: (2011)

SHIFT: the scalable heterogeneous integrated facility for HEP computing
por: Baud, J P, et al.
Publicado: (1991)

Google Cloud Platform for developers: build highly scalable cloud solutions with the power of Google Cloud Platform
por: Hunter, Ted, et al.
Publicado: (2018)

Temporal QoS management in scientific cloud workflow systems
por: Liu, Xiao, et al.
Publicado: (2012)

Scalable Data Processing Model of the ALICE Experiment in the Cloud
por: Loncar, Petra
Publicado: (2023)

Google Cloud Platform administration: design highly available, scalable, and secure cloud solutions on GCP
por: Thakurratan, Ranjit Singh
Publicado: (2018)

Film and video production in the cloud: concepts, workflows, and best practices
por: James, Jack
Publicado: (2017)

Lxcloud: A prototype for an internal cloud in HEP. Experiences and lessons learned
por: Goasguen, Sebastien, et al.
Publicado: (2012)

Large-scale HPC deployment of Scalable CyberInfrastructure for Artificial Intelligence and Likelihood Free Inference (SCAILFIN)
por: Hildreth, Michael, et al.
Publicado: (2020)

Migrating to Azure: transforming legacy applications into scalable cloud-first solutions
por: Garverick, Josh
Publicado: (2018)

Learning Azure Functions: build scalable cloud systems with serverless architecture
por: Yadav, Manisha, et al.
Publicado: (2017)

Declarative Networking
por: Loo, Boon Thau, et al.
Publicado: (2012)

Abstracting container technologies and transfer mechanisms in the Scalable CyberInfrastructure for Artificial Intelligence and Likelihood Free Inference (SCAILFIN) project
por: Hurtado Anampa, Kenyi, et al.
Publicado: (2020)

Simulating HEP Workflows on Heterogeneous Architectures
por: Leggett, Charles, et al.
Publicado: (2018)

Scalable Networking for Cloud Datacenters
por: Bechtolsheim, Andy
Publicado: (2010)

Certain investigation on improved PSO algorithm for workflow scheduling in cloud computing environments
por: Narayanan, Sadhasivam
Publicado: (2017)

Practical Microsoft Azure IaaS: migrating and building scalable and secure cloud solutions
por: Ellis, Gethyn
Publicado: (2018)

Cloud native infrastructure: patterns for scalable infrastructure and applications in a dynamic environment
por: Garrison, Justin, et al.
Publicado: (2018)

Engineering scalable, elastic, and cost-efficient cloud computing applications: the cloudscale method
por: Becker, Steffen, et al.
Publicado: (2017)

Implementing cloud design patterns for AWS: create highly efficient design patterns for scalability, redundancy, and high availability in AWS Cloud
por: Young, Marcus
Publicado: (2015)

Beyond the twelve-factor app: exploring the DNA of highly scalable, resilient cloud applications
por: Hoffman, Kevin
Publicado: (2016)

CernVM Co-Pilot: An extensible framework for building scalable computing infrastructures on the cloud
por: Harutyunyan, A, et al.
Publicado: (2012)

Building intelligent cloud applications: develop scalable models using serverless architectures with Azure
por: Herrera García, Vicente, et al.
Publicado: (2019)

A web-based application for the collection, management and release of alignment and calibration configurations used in data processing at the Compact Muon Solenoid experiment
por: Mecionis, Audrius, et al.
Publicado: (2017)

10 steps to a digital practice in the cloud: new levels of CPA firm workflow efficiency
por: Higgins, John H, et al.
Publicado: (2015)

Hybrid analysis pipelines in the REANA reproducible analysis platform
por: Rodríguez, Diego, et al.
Publicado: (2020)

Enhancements to declarative analysis in ROOT
por: Tumolo, Massimo
Publicado: (2018)

Open data provenance and reproducibility: a case study from publishing CMS open data
por: Šimko, Tibor, et al.
Publicado: (2020)

A scalable infrastructure for CMS data analysis based on OpenStack Cloud and Gluster file system
por: Toor, Salman, et al.
Publicado: (2014)

Amazon Web Services bootcamp: develop a scalable, reliable, and highly available cloud environment with AWS
por: Gulabani, Sunil
Publicado: (2018)

Cannot write session to /tmp/vufind_sessions/sess_gjtm6899k6cn5ji41qeib9uq74