Cargando…

Data at scale: from Storage to Data Governance

<!--HTML-->Data are said to live forever, however their life is a complex journey. Initiated at acquisition or production date, data start a whole life cycle. During the different epochs of this life cycle, data will be moved, processed, compressed, shipped, archived. To ease the management o...

Descripción completa

Detalles Bibliográficos
Autor principal: Acquaviva, Jean-Thomas
Lenguaje:eng
Publicado: 2023
Materias:
Acceso en línea:http://cds.cern.ch/record/2855377
_version_ 1780977455008317440
author Acquaviva, Jean-Thomas
author_facet Acquaviva, Jean-Thomas
author_sort Acquaviva, Jean-Thomas
collection CERN
description <!--HTML-->Data are said to live forever, however their life is a complex journey. Initiated at acquisition or production date, data start a whole life cycle. During the different epochs of this life cycle, data will be moved, processed, compressed, shipped, archived. To ease the management of this data orchestration, modern storage systems provide powerful tools. The foundation of these tools remains the ability to describes data with metadata Metadata can be simple file information (date, size, format) or more complex, defining a structure including discipline-specific schema (or ontologies) used to address specific elements needed by a discipline. In this talk we will present the layered approach of file systems, notably Lustre, to help end-users to implement a data governance solution.
id cern-2855377
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2023
record_format invenio
spelling cern-28553772023-04-03T19:01:41Zhttp://cds.cern.ch/record/2855377engAcquaviva, Jean-ThomasData at scale: from Storage to Data GovernanceCS3 2023 - Cloud Storage Synchronization and SharingHEP Computing<!--HTML-->Data are said to live forever, however their life is a complex journey. Initiated at acquisition or production date, data start a whole life cycle. During the different epochs of this life cycle, data will be moved, processed, compressed, shipped, archived. To ease the management of this data orchestration, modern storage systems provide powerful tools. The foundation of these tools remains the ability to describes data with metadata Metadata can be simple file information (date, size, format) or more complex, defining a structure including discipline-specific schema (or ontologies) used to address specific elements needed by a discipline. In this talk we will present the layered approach of file systems, notably Lustre, to help end-users to implement a data governance solution.oai:cds.cern.ch:28553772023
spellingShingle HEP Computing
Acquaviva, Jean-Thomas
Data at scale: from Storage to Data Governance
title Data at scale: from Storage to Data Governance
title_full Data at scale: from Storage to Data Governance
title_fullStr Data at scale: from Storage to Data Governance
title_full_unstemmed Data at scale: from Storage to Data Governance
title_short Data at scale: from Storage to Data Governance
title_sort data at scale: from storage to data governance
topic HEP Computing
url http://cds.cern.ch/record/2855377
work_keys_str_mv AT acquavivajeanthomas dataatscalefromstoragetodatagovernance
AT acquavivajeanthomas cs32023cloudstoragesynchronizationandsharing