Performance Considerations for Gigabyte per Second Transcontinental Disk-to-Disk File Transfers

Moving data from CERN to Pasadena at a gigabyte per second using the next generation Internet requires good networking and good disk IO. Ten Gbps Ethernet and OC192 links are in place, so now it is simply a matter of programming. This report describes our preliminary work and measurements in configu...

Descripción completa

Detalles Bibliográficos
Autores principales: Kukol, P, Gray, J
Lenguaje:eng
Publicado: 2005
Materias:
Computing and Computers
Acceso en línea:http://cds.cern.ch/record/819966
_version_ 1780905509076860928
author Kukol, P
Gray, J
author_facet Kukol, P
Gray, J
author_sort Kukol, P
collection CERN
description Moving data from CERN to Pasadena at a gigabyte per second using the next generation Internet requires good networking and good disk IO. Ten Gbps Ethernet and OC192 links are in place, so now it is simply a matter of programming. This report describes our preliminary work and measurements in configuring the disk subsystem for this effort. Using 24 SATA disks at each endpoint we are able to locally read and write an NTFS volume is striped across 24 disks at 1.2 GBps. A 32-disk stripe delivers 1.7 GBps. Experiments on higher performance and higher-capacity systems deliver up to 3.5 GBps.
id cern-819966
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2005
record_format invenio
spelling cern-8199662019-09-30T06:29:59Zhttp://cds.cern.ch/record/819966engKukol, PGray, JPerformance Considerations for Gigabyte per Second Transcontinental Disk-to-Disk File TransfersComputing and ComputersMoving data from CERN to Pasadena at a gigabyte per second using the next generation Internet requires good networking and good disk IO. Ten Gbps Ethernet and OC192 links are in place, so now it is simply a matter of programming. This report describes our preliminary work and measurements in configuring the disk subsystem for this effort. Using 24 SATA disks at each endpoint we are able to locally read and write an NTFS volume is striped across 24 disks at 1.2 GBps. A 32-disk stripe delivers 1.7 GBps. Experiments on higher performance and higher-capacity systems deliver up to 3.5 GBps.cs.DB/0502009MSR-TR-2004-62oai:cds.cern.ch:8199662005-02-02
spellingShingle Computing and Computers
Kukol, P
Gray, J
Performance Considerations for Gigabyte per Second Transcontinental Disk-to-Disk File Transfers
title Performance Considerations for Gigabyte per Second Transcontinental Disk-to-Disk File Transfers
title_full Performance Considerations for Gigabyte per Second Transcontinental Disk-to-Disk File Transfers
title_fullStr Performance Considerations for Gigabyte per Second Transcontinental Disk-to-Disk File Transfers
title_full_unstemmed Performance Considerations for Gigabyte per Second Transcontinental Disk-to-Disk File Transfers
title_short Performance Considerations for Gigabyte per Second Transcontinental Disk-to-Disk File Transfers
title_sort performance considerations for gigabyte per second transcontinental disk-to-disk file transfers
topic Computing and Computers
url http://cds.cern.ch/record/819966
work_keys_str_mv AT kukolp performanceconsiderationsforgigabytepersecondtranscontinentaldisktodiskfiletransfers
AT grayj performanceconsiderationsforgigabytepersecondtranscontinentaldisktodiskfiletransfers

Ejemplares similares