Cargando…

Large-Scale Scientific endeavours: the production and dissemination of advance computer sciences knowledge

Perform big data analysis and visualisation on your own computer? Yes, you can! Commodity computers are now very powerful in comparison to only a few years ago. On top of that, the performance of today's software and data development techniques facilitates complex computation with fewer resourc...

Descripción completa

Detalles Bibliográficos
Autor principal: Sanchez Pineda, Arturo
Lenguaje:eng
Publicado: SISSA 2020
Materias:
Acceso en línea:https://dx.doi.org/10.22323/1.372.0040
http://cds.cern.ch/record/2799897
_version_ 1780972593513234432
author Sanchez Pineda, Arturo
author_facet Sanchez Pineda, Arturo
author_sort Sanchez Pineda, Arturo
collection CERN
description Perform big data analysis and visualisation on your own computer? Yes, you can! Commodity computers are now very powerful in comparison to only a few years ago. On top of that, the performance of today's software and data development techniques facilitates complex computation with fewer resources. Cloud computing is not always the solution, and reliability or even privacy is regularly a concern. While the Infrastructure as a Service (IaaS) and Software as a Service (SaaS) philosophies are a key part of current scientific endeavours, there is a misleading feeling that we need to have remote computers to do any kind of data analysis. One of the aims of the ATLAS Open Data project is to provide resources — data, software and documents — that can be stored and executed in computers with minimal or non-internet access, and in as many different operating systems as possible. This approach is viewed as complementary to the IaaS/SaaS approach, where local university, students and trainers' resources can be used in an effective and reproducible way — making the High Energy Physics and Computer Sciences fields accessible to more people. We present the latest developments in the production and use of local Virtual Machines and Docker Containers for the development of physics data analysis. We also discuss example software and Jupyter notebooks, which are in constant development for use in classrooms, and students and teachers computers around the world. Also, we showcase how those tools are developed and in use by international efforts (IPPOG, ICTP-PWF and CEVALE2VE.org) in Latin America and Europe to bring knowledge in countries like Mexico, Venezuela, Colombia, Peru, Ecuador, Argentina and Uruguay with support of the ICTP, CERN and many universities in the region.
id cern-2799897
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2020
publisher SISSA
record_format invenio
spelling cern-27998972022-01-20T21:41:19Zdoi:10.22323/1.372.0040http://cds.cern.ch/record/2799897engSanchez Pineda, ArturoLarge-Scale Scientific endeavours: the production and dissemination of advance computer sciences knowledgeComputing and ComputersPerform big data analysis and visualisation on your own computer? Yes, you can! Commodity computers are now very powerful in comparison to only a few years ago. On top of that, the performance of today's software and data development techniques facilitates complex computation with fewer resources. Cloud computing is not always the solution, and reliability or even privacy is regularly a concern. While the Infrastructure as a Service (IaaS) and Software as a Service (SaaS) philosophies are a key part of current scientific endeavours, there is a misleading feeling that we need to have remote computers to do any kind of data analysis. One of the aims of the ATLAS Open Data project is to provide resources — data, software and documents — that can be stored and executed in computers with minimal or non-internet access, and in as many different operating systems as possible. This approach is viewed as complementary to the IaaS/SaaS approach, where local university, students and trainers' resources can be used in an effective and reproducible way — making the High Energy Physics and Computer Sciences fields accessible to more people. We present the latest developments in the production and use of local Virtual Machines and Docker Containers for the development of physics data analysis. We also discuss example software and Jupyter notebooks, which are in constant development for use in classrooms, and students and teachers computers around the world. Also, we showcase how those tools are developed and in use by international efforts (IPPOG, ICTP-PWF and CEVALE2VE.org) in Latin America and Europe to bring knowledge in countries like Mexico, Venezuela, Colombia, Peru, Ecuador, Argentina and Uruguay with support of the ICTP, CERN and many universities in the region.SISSAoai:cds.cern.ch:27998972020
spellingShingle Computing and Computers
Sanchez Pineda, Arturo
Large-Scale Scientific endeavours: the production and dissemination of advance computer sciences knowledge
title Large-Scale Scientific endeavours: the production and dissemination of advance computer sciences knowledge
title_full Large-Scale Scientific endeavours: the production and dissemination of advance computer sciences knowledge
title_fullStr Large-Scale Scientific endeavours: the production and dissemination of advance computer sciences knowledge
title_full_unstemmed Large-Scale Scientific endeavours: the production and dissemination of advance computer sciences knowledge
title_short Large-Scale Scientific endeavours: the production and dissemination of advance computer sciences knowledge
title_sort large-scale scientific endeavours: the production and dissemination of advance computer sciences knowledge
topic Computing and Computers
url https://dx.doi.org/10.22323/1.372.0040
http://cds.cern.ch/record/2799897
work_keys_str_mv AT sanchezpinedaarturo largescalescientificendeavourstheproductionanddisseminationofadvancecomputersciencesknowledge