Cargando…
Sharing server nodes for storage and compute
Based on the observation of low average CPU utilisation of several hundred file storage servers in the EOS storage system at CERN, the Batch on EOS Extra Resources (BEER) project developed an approach to also utilise these resources for batch processing. Initial proof of concept tests showed little...
| Autores principales: | , , , , , , , , , , , , |
|---|---|
| Lenguaje: | eng |
| Publicado: |
2018
|
| Materias: | |
| Acceso en línea: | https://dx.doi.org/10.1051/epjconf/201921408025 http://cds.cern.ch/record/2653012 |
| _version_ | 1780961012713783296 |
|---|---|
| author | Smith, David Di Girolamo, Alessandro Glushkov, Ivan Jones, Ben Kiryanov, Andrey Lamanna, Massimo Mascetti, Luca McCance, Gavin Rousseau, Herve Schovancova, Jaroslava Schulz, Markus Tollefsen, Havard Valassi, Andrea |
| author_facet | Smith, David Di Girolamo, Alessandro Glushkov, Ivan Jones, Ben Kiryanov, Andrey Lamanna, Massimo Mascetti, Luca McCance, Gavin Rousseau, Herve Schovancova, Jaroslava Schulz, Markus Tollefsen, Havard Valassi, Andrea |
| author_sort | Smith, David |
| collection | CERN |
| description | Based on the observation of low average CPU utilisation of several hundred file storage servers in the EOS storage system at CERN, the Batch on EOS Extra Resources (BEER) project developed an approach to also utilise these resources for batch processing. Initial proof of concept tests showed little interference between batch and storage services on a node. Subsequently a model for production was developed and implemented. This has been deployed on part of the CERN EOS production service. The implementation and test results will be presented. The potential for additional resources at the CERN Tier-0 centre is of the order of ten thousand hardware threads in the near term, as well as being a step towards a hyper-converged infrastructure. |
| id | cern-2653012 |
| institution | Organización Europea para la Investigación Nuclear |
| language | eng |
| publishDate | 2018 |
| record_format | invenio |
| spelling | cern-26530122022-08-10T12:23:39Zdoi:10.1051/epjconf/201921408025http://cds.cern.ch/record/2653012engSmith, DavidDi Girolamo, AlessandroGlushkov, IvanJones, BenKiryanov, AndreyLamanna, MassimoMascetti, LucaMcCance, GavinRousseau, HerveSchovancova, JaroslavaSchulz, MarkusTollefsen, HavardValassi, AndreaSharing server nodes for storage and computeComputing and ComputersBased on the observation of low average CPU utilisation of several hundred file storage servers in the EOS storage system at CERN, the Batch on EOS Extra Resources (BEER) project developed an approach to also utilise these resources for batch processing. Initial proof of concept tests showed little interference between batch and storage services on a node. Subsequently a model for production was developed and implemented. This has been deployed on part of the CERN EOS production service. The implementation and test results will be presented. The potential for additional resources at the CERN Tier-0 centre is of the order of ten thousand hardware threads in the near term, as well as being a step towards a hyper-converged infrastructure.CERN-IT-Note-2019-001oai:cds.cern.ch:26530122018-11-30 |
| spellingShingle | Computing and Computers Smith, David Di Girolamo, Alessandro Glushkov, Ivan Jones, Ben Kiryanov, Andrey Lamanna, Massimo Mascetti, Luca McCance, Gavin Rousseau, Herve Schovancova, Jaroslava Schulz, Markus Tollefsen, Havard Valassi, Andrea Sharing server nodes for storage and compute |
| title | Sharing server nodes for storage and compute |
| title_full | Sharing server nodes for storage and compute |
| title_fullStr | Sharing server nodes for storage and compute |
| title_full_unstemmed | Sharing server nodes for storage and compute |
| title_short | Sharing server nodes for storage and compute |
| title_sort | sharing server nodes for storage and compute |
| topic | Computing and Computers |
| url | https://dx.doi.org/10.1051/epjconf/201921408025 http://cds.cern.ch/record/2653012 |
| work_keys_str_mv | AT smithdavid sharingservernodesforstorageandcompute AT digirolamoalessandro sharingservernodesforstorageandcompute AT glushkovivan sharingservernodesforstorageandcompute AT jonesben sharingservernodesforstorageandcompute AT kiryanovandrey sharingservernodesforstorageandcompute AT lamannamassimo sharingservernodesforstorageandcompute AT mascettiluca sharingservernodesforstorageandcompute AT mccancegavin sharingservernodesforstorageandcompute AT rousseauherve sharingservernodesforstorageandcompute AT schovancovajaroslava sharingservernodesforstorageandcompute AT schulzmarkus sharingservernodesforstorageandcompute AT tollefsenhavard sharingservernodesforstorageandcompute AT valassiandrea sharingservernodesforstorageandcompute |