Using Solid State Disk Array as a Cache for LHC ATLAS Data Analysis

Mostrar otras versiones (1)

User data analysis in high energy physics presents a challenge to spinning-disk based storage systems. The analysis is data intense, yet reads are small, sparse and cover a large volume of data files. It is also unpredictable due to users' response to storage performance. We describe here a sys...

Descripción completa

Detalles Bibliográficos
Autores principales: Yang, W, Hanushevsky, A, Mount, R
Lenguaje:eng
Publicado: 2013
Materias:
Detectors and Experimental Techniques
Acceso en línea:http://cds.cern.ch/record/1609642
_version_ 1780931970390294528
author Yang, W
Hanushevsky, A
Mount, R
author_facet Yang, W
Hanushevsky, A
Mount, R
author_sort Yang, W
collection CERN
description User data analysis in high energy physics presents a challenge to spinning-disk based storage systems. The analysis is data intense, yet reads are small, sparse and cover a large volume of data files. It is also unpredictable due to users' response to storage performance. We describe here a system with an array of Solid State Disk as a non-conventional, standalone file level cache in front of the spinning disk storage to help improve the performance of LHC ATLAS user analysis at SLAC. The system uses a long period of data access records to make caching decisions. It can also use information from other sources such as a work-flow management system. We evaluate the performance of the system both in terms of caching and its impact on user analysis jobs. The system currently uses Xrootd technology, but the technique can be applied to any storage system.
id cern-1609642
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2013
record_format invenio
spelling cern-16096422019-09-30T06:29:59Zhttp://cds.cern.ch/record/1609642engYang, WHanushevsky, AMount, RUsing Solid State Disk Array as a Cache for LHC ATLAS Data AnalysisDetectors and Experimental TechniquesUser data analysis in high energy physics presents a challenge to spinning-disk based storage systems. The analysis is data intense, yet reads are small, sparse and cover a large volume of data files. It is also unpredictable due to users' response to storage performance. We describe here a system with an array of Solid State Disk as a non-conventional, standalone file level cache in front of the spinning disk storage to help improve the performance of LHC ATLAS user analysis at SLAC. The system uses a long period of data access records to make caching decisions. It can also use information from other sources such as a work-flow management system. We evaluate the performance of the system both in terms of caching and its impact on user analysis jobs. The system currently uses Xrootd technology, but the technique can be applied to any storage system.ATL-SOFT-SLIDE-2013-838oai:cds.cern.ch:16096422013-10-12
spellingShingle Detectors and Experimental Techniques
Yang, W
Hanushevsky, A
Mount, R
Using Solid State Disk Array as a Cache for LHC ATLAS Data Analysis
title Using Solid State Disk Array as a Cache for LHC ATLAS Data Analysis
title_full Using Solid State Disk Array as a Cache for LHC ATLAS Data Analysis
title_fullStr Using Solid State Disk Array as a Cache for LHC ATLAS Data Analysis
title_full_unstemmed Using Solid State Disk Array as a Cache for LHC ATLAS Data Analysis
title_short Using Solid State Disk Array as a Cache for LHC ATLAS Data Analysis
title_sort using solid state disk array as a cache for lhc atlas data analysis
topic Detectors and Experimental Techniques
url http://cds.cern.ch/record/1609642
work_keys_str_mv AT yangw usingsolidstatediskarrayasacacheforlhcatlasdataanalysis
AT hanushevskya usingsolidstatediskarrayasacacheforlhcatlasdataanalysis
AT mountr usingsolidstatediskarrayasacacheforlhcatlasdataanalysis

Ejemplares similares