Cargando…
Data at scale: from Storage to Data Governance
<!--HTML-->Data are said to live forever, however their life is a complex journey. Initiated at acquisition or production date, data start a whole life cycle. During the different epochs of this life cycle, data will be moved, processed, compressed, shipped, archived. To ease the management o...
Autor principal: | |
---|---|
Lenguaje: | eng |
Publicado: |
2023
|
Materias: | |
Acceso en línea: | http://cds.cern.ch/record/2855377 |
_version_ | 1780977455008317440 |
---|---|
author | Acquaviva, Jean-Thomas |
author_facet | Acquaviva, Jean-Thomas |
author_sort | Acquaviva, Jean-Thomas |
collection | CERN |
description | <!--HTML-->Data are said to live forever, however their life is a complex journey. Initiated at acquisition or production date, data start a whole life cycle. During the different epochs of this life cycle, data will be moved, processed, compressed, shipped, archived.
To ease the management of this data orchestration, modern storage systems provide powerful tools. The foundation of these tools remains the ability to describes data with metadata
Metadata can be simple file information (date, size, format) or more complex, defining a structure including discipline-specific schema (or ontologies) used to address specific elements needed by a discipline.
In this talk we will present the layered approach of file systems, notably Lustre, to help end-users to implement a data governance solution. |
id | cern-2855377 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2023 |
record_format | invenio |
spelling | cern-28553772023-04-03T19:01:41Zhttp://cds.cern.ch/record/2855377engAcquaviva, Jean-ThomasData at scale: from Storage to Data GovernanceCS3 2023 - Cloud Storage Synchronization and SharingHEP Computing<!--HTML-->Data are said to live forever, however their life is a complex journey. Initiated at acquisition or production date, data start a whole life cycle. During the different epochs of this life cycle, data will be moved, processed, compressed, shipped, archived. To ease the management of this data orchestration, modern storage systems provide powerful tools. The foundation of these tools remains the ability to describes data with metadata Metadata can be simple file information (date, size, format) or more complex, defining a structure including discipline-specific schema (or ontologies) used to address specific elements needed by a discipline. In this talk we will present the layered approach of file systems, notably Lustre, to help end-users to implement a data governance solution.oai:cds.cern.ch:28553772023 |
spellingShingle | HEP Computing Acquaviva, Jean-Thomas Data at scale: from Storage to Data Governance |
title | Data at scale: from Storage to Data Governance |
title_full | Data at scale: from Storage to Data Governance |
title_fullStr | Data at scale: from Storage to Data Governance |
title_full_unstemmed | Data at scale: from Storage to Data Governance |
title_short | Data at scale: from Storage to Data Governance |
title_sort | data at scale: from storage to data governance |
topic | HEP Computing |
url | http://cds.cern.ch/record/2855377 |
work_keys_str_mv | AT acquavivajeanthomas dataatscalefromstoragetodatagovernance AT acquavivajeanthomas cs32023cloudstoragesynchronizationandsharing |