Cargando…
Examining the Impact of Data Layout on Tape on Data Recall Performance for ATLAS
Increases in data volumes are forcing high-energy and nuclear physics experiments to store more frequently accessed data on tape. Extracting the maximum performance from tape drives is critical to make this viable from a data availability and system cost standpoint. The nature of data ingest and ret...
Autor principal: | |
---|---|
Lenguaje: | eng |
Publicado: |
2023
|
Materias: | |
Acceso en línea: | http://cds.cern.ch/record/2857488 |
_version_ | 1780977565616308224 |
---|---|
author | Misawa, Shigeki |
author_facet | Misawa, Shigeki |
author_sort | Misawa, Shigeki |
collection | CERN |
description | Increases in data volumes are forcing high-energy and nuclear physics experiments to store more frequently accessed data on tape. Extracting the maximum performance from tape drives is critical to make this viable from a data availability and system cost standpoint. The nature of data ingest and retrieval in an experimental physics environment make achieving high access performance difficult given the inherent limitations of magnetic tape. Tailoring the layout of data on tape is one key to improving read performance. This paper highlights the work in progress to characterize ATLAS data ingested in the tape system, understand how data layout, i.e. file co-location on tape and file distribution over tapes, affect read performance and how optimal data layout might be achieved in a production environment. |
id | cern-2857488 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2023 |
record_format | invenio |
spelling | cern-28574882023-05-03T00:32:56Zhttp://cds.cern.ch/record/2857488engMisawa, ShigekiExamining the Impact of Data Layout on Tape on Data Recall Performance for ATLASParticle Physics - ExperimentIncreases in data volumes are forcing high-energy and nuclear physics experiments to store more frequently accessed data on tape. Extracting the maximum performance from tape drives is critical to make this viable from a data availability and system cost standpoint. The nature of data ingest and retrieval in an experimental physics environment make achieving high access performance difficult given the inherent limitations of magnetic tape. Tailoring the layout of data on tape is one key to improving read performance. This paper highlights the work in progress to characterize ATLAS data ingested in the tape system, understand how data layout, i.e. file co-location on tape and file distribution over tapes, affect read performance and how optimal data layout might be achieved in a production environment.ATL-SOFT-SLIDE-2023-119oai:cds.cern.ch:28574882023-05-02 |
spellingShingle | Particle Physics - Experiment Misawa, Shigeki Examining the Impact of Data Layout on Tape on Data Recall Performance for ATLAS |
title | Examining the Impact of Data Layout on Tape on Data Recall Performance for ATLAS |
title_full | Examining the Impact of Data Layout on Tape on Data Recall Performance for ATLAS |
title_fullStr | Examining the Impact of Data Layout on Tape on Data Recall Performance for ATLAS |
title_full_unstemmed | Examining the Impact of Data Layout on Tape on Data Recall Performance for ATLAS |
title_short | Examining the Impact of Data Layout on Tape on Data Recall Performance for ATLAS |
title_sort | examining the impact of data layout on tape on data recall performance for atlas |
topic | Particle Physics - Experiment |
url | http://cds.cern.ch/record/2857488 |
work_keys_str_mv | AT misawashigeki examiningtheimpactofdatalayoutontapeondatarecallperformanceforatlas |