Cargando…

Modernizing Legacy Codes for Next-Generation Storage Infrastructures: A Case Study of PALM on Intel DAOS

<!--HTML-->We present our early experiences with the Distributed Asynchronous Object Storage (DAOS) focusing on its usage for checkpointing with the real-world scientific application PALM. The presentation includes an introduction of the of large eddy simulation and its legacy Fortran IO check...

Descripción completa

Detalles Bibliográficos
Autor principal: Christgau, Steffen
Lenguaje:eng
Publicado: 2019
Materias:
Acceso en línea:http://cds.cern.ch/record/2691952
_version_ 1780963917655179264
author Christgau, Steffen
author_facet Christgau, Steffen
author_sort Christgau, Steffen
collection CERN
description <!--HTML-->We present our early experiences with the Distributed Asynchronous Object Storage (DAOS) focusing on its usage for checkpointing with the real-world scientific application PALM. The presentation includes an introduction of the of large eddy simulation and its legacy Fortran IO checkpointing mechanism. A thin software layer is introduced to remove the hard-coded IO operations by generic API calls. This abstraction enables the application to support both Fortran Stream IO, MPI IO, as well as netCDF on top of HDF5 which is the principal foundation for using DAOS in our use-case. We present early performance numbers on a Cascade Lake test system with Optane DCPMM and a comparison with the Lustre-based infrastructure of the HLRN-IV phase 1 system. The talk also presents some of the lessons learned from adjusting the application's legacy checkpointing code to a modern software environment.
id cern-2691952
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2019
record_format invenio
spelling cern-26919522022-11-02T22:24:40Zhttp://cds.cern.ch/record/2691952engChristgau, SteffenModernizing Legacy Codes for Next-Generation Storage Infrastructures: A Case Study of PALM on Intel DAOSIXPUG 2019 Annual Conference at CERNother events or meetings<!--HTML-->We present our early experiences with the Distributed Asynchronous Object Storage (DAOS) focusing on its usage for checkpointing with the real-world scientific application PALM. The presentation includes an introduction of the of large eddy simulation and its legacy Fortran IO checkpointing mechanism. A thin software layer is introduced to remove the hard-coded IO operations by generic API calls. This abstraction enables the application to support both Fortran Stream IO, MPI IO, as well as netCDF on top of HDF5 which is the principal foundation for using DAOS in our use-case. We present early performance numbers on a Cascade Lake test system with Optane DCPMM and a comparison with the Lustre-based infrastructure of the HLRN-IV phase 1 system. The talk also presents some of the lessons learned from adjusting the application's legacy checkpointing code to a modern software environment.oai:cds.cern.ch:26919522019
spellingShingle other events or meetings
Christgau, Steffen
Modernizing Legacy Codes for Next-Generation Storage Infrastructures: A Case Study of PALM on Intel DAOS
title Modernizing Legacy Codes for Next-Generation Storage Infrastructures: A Case Study of PALM on Intel DAOS
title_full Modernizing Legacy Codes for Next-Generation Storage Infrastructures: A Case Study of PALM on Intel DAOS
title_fullStr Modernizing Legacy Codes for Next-Generation Storage Infrastructures: A Case Study of PALM on Intel DAOS
title_full_unstemmed Modernizing Legacy Codes for Next-Generation Storage Infrastructures: A Case Study of PALM on Intel DAOS
title_short Modernizing Legacy Codes for Next-Generation Storage Infrastructures: A Case Study of PALM on Intel DAOS
title_sort modernizing legacy codes for next-generation storage infrastructures: a case study of palm on intel daos
topic other events or meetings
url http://cds.cern.ch/record/2691952
work_keys_str_mv AT christgausteffen modernizinglegacycodesfornextgenerationstorageinfrastructuresacasestudyofpalmoninteldaos
AT christgausteffen ixpug2019annualconferenceatcern