File Access Optimization with the Lustre Filesystem at Florida CMS T2

The Florida CMS Tier2 center, one of the CMS Tier2 centers, has been using the Lustre filesystem for its data storage backend system since 2004. Recently, the data access pattern at our site has changed greatly due to various new access methods that include file transfers through the GridFTP servers...

Descripción completa

Detalles Bibliográficos
Autores principales: Avery, P, Bourilkov, D, Fu, Y, Kim, B
Lenguaje:eng
Publicado: 2015
Materias:
Computing and Computers
Acceso en línea:https://dx.doi.org/10.1088/1742-6596/664/4/042028
http://cds.cern.ch/record/2134568
_version_ 1780949906418040832
author Avery, P
Bourilkov, D
Fu, Y
Kim, B
author_facet Avery, P
Bourilkov, D
Fu, Y
Kim, B
author_sort Avery, P
collection CERN
description The Florida CMS Tier2 center, one of the CMS Tier2 centers, has been using the Lustre filesystem for its data storage backend system since 2004. Recently, the data access pattern at our site has changed greatly due to various new access methods that include file transfers through the GridFTP servers, read access from the worker nodes, and the remote read access through the xrootd servers. In order to optimize the file access performance, we have to consider all the possible access patterns and each pattern needs to be studied separately. In this presentation, we report on our work to optimize file access with the Lustre filesystem at the Florida CMS T2 using an approach based on analyzing these access patterns.
id oai-inspirehep.net-1413859
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2015
record_format invenio
spelling oai-inspirehep.net-14138592022-08-10T12:58:42Zdoi:10.1088/1742-6596/664/4/042028http://cds.cern.ch/record/2134568engAvery, PBourilkov, DFu, YKim, BFile Access Optimization with the Lustre Filesystem at Florida CMS T2Computing and ComputersThe Florida CMS Tier2 center, one of the CMS Tier2 centers, has been using the Lustre filesystem for its data storage backend system since 2004. Recently, the data access pattern at our site has changed greatly due to various new access methods that include file transfers through the GridFTP servers, read access from the worker nodes, and the remote read access through the xrootd servers. In order to optimize the file access performance, we have to consider all the possible access patterns and each pattern needs to be studied separately. In this presentation, we report on our work to optimize file access with the Lustre filesystem at the Florida CMS T2 using an approach based on analyzing these access patterns.oai:inspirehep.net:14138592015
spellingShingle Computing and Computers
Avery, P
Bourilkov, D
Fu, Y
Kim, B
File Access Optimization with the Lustre Filesystem at Florida CMS T2
title File Access Optimization with the Lustre Filesystem at Florida CMS T2
title_full File Access Optimization with the Lustre Filesystem at Florida CMS T2
title_fullStr File Access Optimization with the Lustre Filesystem at Florida CMS T2
title_full_unstemmed File Access Optimization with the Lustre Filesystem at Florida CMS T2
title_short File Access Optimization with the Lustre Filesystem at Florida CMS T2
title_sort file access optimization with the lustre filesystem at florida cms t2
topic Computing and Computers
url https://dx.doi.org/10.1088/1742-6596/664/4/042028
http://cds.cern.ch/record/2134568
work_keys_str_mv AT averyp fileaccessoptimizationwiththelustrefilesystematfloridacmst2
AT bourilkovd fileaccessoptimizationwiththelustrefilesystematfloridacmst2
AT fuy fileaccessoptimizationwiththelustrefilesystematfloridacmst2
AT kimb fileaccessoptimizationwiththelustrefilesystematfloridacmst2

Ejemplares similares