Cargando…

Building A High Performance Parallel File System Using Grid Datafarm and ROOT I/O

Sheer amount of petabyte scale data foreseen in the LHC experiments require a careful consideration of the persistency design and the system design in the world-wide distributed computing. Event parallelism of the HENP data analysis enables us to take maximum advantage of the high performance cluste...

Descripción completa

Detalles Bibliográficos
Autores principales: Morita, Y., Sato, H., Watase, Y., Tatebe, Osamu, Sekiguchi, S., Matsuoka, S., Soda, N., Dell'Acqua, A.
Lenguaje:eng
Publicado: 2003
Materias:
Acceso en línea:http://cds.cern.ch/record/622182
_version_ 1780900420910055424
author Morita, Y.
Sato, H.
Watase, Y.
Tatebe, Osamu
Sekiguchi, S.
Matsuoka, S.
Soda, N.
Dell'Acqua, A.
author_facet Morita, Y.
Sato, H.
Watase, Y.
Tatebe, Osamu
Sekiguchi, S.
Matsuoka, S.
Soda, N.
Dell'Acqua, A.
author_sort Morita, Y.
collection CERN
description Sheer amount of petabyte scale data foreseen in the LHC experiments require a careful consideration of the persistency design and the system design in the world-wide distributed computing. Event parallelism of the HENP data analysis enables us to take maximum advantage of the high performance cluster computing and networking when we keep the parallelism both in the data processing phase, in the data management phase, and in the data transfer phase. A modular architecture of FADS/ Goofy, a versatile detector simulation framework for Geant4, enables an easy choice of plug-in facilities for persistency technologies such as Objectivity/DB and ROOT I/O. The framework is designed to work naturally with the parallel file system of Grid Datafarm (Gfarm). FADS/Goofy is proven to generate 10^6 Geant4-simulated Atlas Mockup events using a 512 CPU PC cluster. The data in ROOT I/O files is replicated using Gfarm file system. The histogram information is collected from the distributed ROOT files. During the data replication it has been demonstrated to achieve more than 2.3 Gbps data transfer rate between the PC clusters over seven participating PC clusters in the United States and in Japan.
id cern-622182
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2003
record_format invenio
spelling cern-6221822023-03-14T17:06:00Zhttp://cds.cern.ch/record/622182engMorita, Y.Sato, H.Watase, Y.Tatebe, OsamuSekiguchi, S.Matsuoka, S.Soda, N.Dell'Acqua, A.Building A High Performance Parallel File System Using Grid Datafarm and ROOT I/OComputing and ComputersSheer amount of petabyte scale data foreseen in the LHC experiments require a careful consideration of the persistency design and the system design in the world-wide distributed computing. Event parallelism of the HENP data analysis enables us to take maximum advantage of the high performance cluster computing and networking when we keep the parallelism both in the data processing phase, in the data management phase, and in the data transfer phase. A modular architecture of FADS/ Goofy, a versatile detector simulation framework for Geant4, enables an easy choice of plug-in facilities for persistency technologies such as Objectivity/DB and ROOT I/O. The framework is designed to work naturally with the parallel file system of Grid Datafarm (Gfarm). FADS/Goofy is proven to generate 10^6 Geant4-simulated Atlas Mockup events using a 512 CPU PC cluster. The data in ROOT I/O files is replicated using Gfarm file system. The histogram information is collected from the distributed ROOT files. During the data replication it has been demonstrated to achieve more than 2.3 Gbps data transfer rate between the PC clusters over seven participating PC clusters in the United States and in Japan.Sheer amount of petabyte scale data foreseen in the LHC experiments require a careful consideration of the persistency design and the system design in the world-wide distributed computing. Event parallelism of the HENP data analysis enables us to take maximum advantage of the high performance cluster computing and networking when we keep the parallelism both in the data processing phase, in the data management phase, and in the data transfer phase. A modular architecture of FADS/ Goofy, a versatile detector simulation framework for Geant4, enables an easy choice of plug-in facilities for persistency technologies such as Objectivity/DB and ROOT I/O. The framework is designed to work naturally with the parallel file system of Grid Datafarm (Gfarm). FADS/Goofy is proven to generate 10^6 Geant4-simulated Atlas Mockup events using a 512 CPU PC cluster. The data in ROOT I/O files is replicated using Gfarm file system. The histogram information is collected from the distributed ROOT files. During the data replication it has been demonstrated to achieve more than 2.3 Gbps data transfer rate between the PC clusters over seven participating PC clusters in the United States and in Japan.CHEP-2003-TUDT010cs/0306092oai:cds.cern.ch:6221822003-06-14
spellingShingle Computing and Computers
Morita, Y.
Sato, H.
Watase, Y.
Tatebe, Osamu
Sekiguchi, S.
Matsuoka, S.
Soda, N.
Dell'Acqua, A.
Building A High Performance Parallel File System Using Grid Datafarm and ROOT I/O
title Building A High Performance Parallel File System Using Grid Datafarm and ROOT I/O
title_full Building A High Performance Parallel File System Using Grid Datafarm and ROOT I/O
title_fullStr Building A High Performance Parallel File System Using Grid Datafarm and ROOT I/O
title_full_unstemmed Building A High Performance Parallel File System Using Grid Datafarm and ROOT I/O
title_short Building A High Performance Parallel File System Using Grid Datafarm and ROOT I/O
title_sort building a high performance parallel file system using grid datafarm and root i/o
topic Computing and Computers
url http://cds.cern.ch/record/622182
work_keys_str_mv AT moritay buildingahighperformanceparallelfilesystemusinggriddatafarmandrootio
AT satoh buildingahighperformanceparallelfilesystemusinggriddatafarmandrootio
AT watasey buildingahighperformanceparallelfilesystemusinggriddatafarmandrootio
AT tatebeosamu buildingahighperformanceparallelfilesystemusinggriddatafarmandrootio
AT sekiguchis buildingahighperformanceparallelfilesystemusinggriddatafarmandrootio
AT matsuokas buildingahighperformanceparallelfilesystemusinggriddatafarmandrootio
AT sodan buildingahighperformanceparallelfilesystemusinggriddatafarmandrootio
AT dellacquaa buildingahighperformanceparallelfilesystemusinggriddatafarmandrootio