Cargando…
Building A High Performance Parallel File System Using Grid Datafarm and ROOT I/O
Sheer amount of petabyte scale data foreseen in the LHC experiments require a careful consideration of the persistency design and the system design in the world-wide distributed computing. Event parallelism of the HENP data analysis enables us to take maximum advantage of the high performance cluste...
Autores principales: | , , , , , , , |
---|---|
Lenguaje: | eng |
Publicado: |
2003
|
Materias: | |
Acceso en línea: | http://cds.cern.ch/record/622182 |
_version_ | 1780900420910055424 |
---|---|
author | Morita, Y. Sato, H. Watase, Y. Tatebe, Osamu Sekiguchi, S. Matsuoka, S. Soda, N. Dell'Acqua, A. |
author_facet | Morita, Y. Sato, H. Watase, Y. Tatebe, Osamu Sekiguchi, S. Matsuoka, S. Soda, N. Dell'Acqua, A. |
author_sort | Morita, Y. |
collection | CERN |
description | Sheer amount of petabyte scale data foreseen in the LHC experiments require a careful consideration of the persistency design and the system design in the world-wide distributed computing. Event parallelism of the HENP data analysis enables us to take maximum advantage of the high performance cluster computing and networking when we keep the parallelism both in the data processing phase, in the data management phase, and in the data transfer phase. A modular architecture of FADS/ Goofy, a versatile detector simulation framework for Geant4, enables an easy choice of plug-in facilities for persistency technologies such as Objectivity/DB and ROOT I/O. The framework is designed to work naturally with the parallel file system of Grid Datafarm (Gfarm). FADS/Goofy is proven to generate 10^6 Geant4-simulated Atlas Mockup events using a 512 CPU PC cluster. The data in ROOT I/O files is replicated using Gfarm file system. The histogram information is collected from the distributed ROOT files. During the data replication it has been demonstrated to achieve more than 2.3 Gbps data transfer rate between the PC clusters over seven participating PC clusters in the United States and in Japan. |
id | cern-622182 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2003 |
record_format | invenio |
spelling | cern-6221822023-03-14T17:06:00Zhttp://cds.cern.ch/record/622182engMorita, Y.Sato, H.Watase, Y.Tatebe, OsamuSekiguchi, S.Matsuoka, S.Soda, N.Dell'Acqua, A.Building A High Performance Parallel File System Using Grid Datafarm and ROOT I/OComputing and ComputersSheer amount of petabyte scale data foreseen in the LHC experiments require a careful consideration of the persistency design and the system design in the world-wide distributed computing. Event parallelism of the HENP data analysis enables us to take maximum advantage of the high performance cluster computing and networking when we keep the parallelism both in the data processing phase, in the data management phase, and in the data transfer phase. A modular architecture of FADS/ Goofy, a versatile detector simulation framework for Geant4, enables an easy choice of plug-in facilities for persistency technologies such as Objectivity/DB and ROOT I/O. The framework is designed to work naturally with the parallel file system of Grid Datafarm (Gfarm). FADS/Goofy is proven to generate 10^6 Geant4-simulated Atlas Mockup events using a 512 CPU PC cluster. The data in ROOT I/O files is replicated using Gfarm file system. The histogram information is collected from the distributed ROOT files. During the data replication it has been demonstrated to achieve more than 2.3 Gbps data transfer rate between the PC clusters over seven participating PC clusters in the United States and in Japan.Sheer amount of petabyte scale data foreseen in the LHC experiments require a careful consideration of the persistency design and the system design in the world-wide distributed computing. Event parallelism of the HENP data analysis enables us to take maximum advantage of the high performance cluster computing and networking when we keep the parallelism both in the data processing phase, in the data management phase, and in the data transfer phase. A modular architecture of FADS/ Goofy, a versatile detector simulation framework for Geant4, enables an easy choice of plug-in facilities for persistency technologies such as Objectivity/DB and ROOT I/O. The framework is designed to work naturally with the parallel file system of Grid Datafarm (Gfarm). FADS/Goofy is proven to generate 10^6 Geant4-simulated Atlas Mockup events using a 512 CPU PC cluster. The data in ROOT I/O files is replicated using Gfarm file system. The histogram information is collected from the distributed ROOT files. During the data replication it has been demonstrated to achieve more than 2.3 Gbps data transfer rate between the PC clusters over seven participating PC clusters in the United States and in Japan.CHEP-2003-TUDT010cs/0306092oai:cds.cern.ch:6221822003-06-14 |
spellingShingle | Computing and Computers Morita, Y. Sato, H. Watase, Y. Tatebe, Osamu Sekiguchi, S. Matsuoka, S. Soda, N. Dell'Acqua, A. Building A High Performance Parallel File System Using Grid Datafarm and ROOT I/O |
title | Building A High Performance Parallel File System Using Grid Datafarm and ROOT I/O |
title_full | Building A High Performance Parallel File System Using Grid Datafarm and ROOT I/O |
title_fullStr | Building A High Performance Parallel File System Using Grid Datafarm and ROOT I/O |
title_full_unstemmed | Building A High Performance Parallel File System Using Grid Datafarm and ROOT I/O |
title_short | Building A High Performance Parallel File System Using Grid Datafarm and ROOT I/O |
title_sort | building a high performance parallel file system using grid datafarm and root i/o |
topic | Computing and Computers |
url | http://cds.cern.ch/record/622182 |
work_keys_str_mv | AT moritay buildingahighperformanceparallelfilesystemusinggriddatafarmandrootio AT satoh buildingahighperformanceparallelfilesystemusinggriddatafarmandrootio AT watasey buildingahighperformanceparallelfilesystemusinggriddatafarmandrootio AT tatebeosamu buildingahighperformanceparallelfilesystemusinggriddatafarmandrootio AT sekiguchis buildingahighperformanceparallelfilesystemusinggriddatafarmandrootio AT matsuokas buildingahighperformanceparallelfilesystemusinggriddatafarmandrootio AT sodan buildingahighperformanceparallelfilesystemusinggriddatafarmandrootio AT dellacquaa buildingahighperformanceparallelfilesystemusinggriddatafarmandrootio |