Cargando…

Data Synchronization Method Between FLPs and EPNs

In the year 2018, the ALICE detectors will be upgraded and the amount of data that will be produced from the detectors will be higher. The data throughput will be approximately 1 TB per second. For this reason, the whole ALICE's system has to be improved. The constraint of the new ALICE experim...

Descripción completa

Detalles Bibliográficos
Autor principal: Pumma, Sarunya
Lenguaje:eng
Publicado: 2014
Materias:
Acceso en línea:http://cds.cern.ch/record/1748457
_version_ 1780943000646451200
author Pumma, Sarunya
author_facet Pumma, Sarunya
author_sort Pumma, Sarunya
collection CERN
description In the year 2018, the ALICE detectors will be upgraded and the amount of data that will be produced from the detectors will be higher. The data throughput will be approximately 1 TB per second. For this reason, the whole ALICE's system has to be improved. The constraint of the new ALICE experiments is the system should be able to handle a large amount of particles collision events that will be produced from detectors. The data acquisition comprises two computer clusters – First Level Processors (FLP) and Event Processing Nodes (EPN). The two clusters serve different purposes. The FLP cluster is responsible to readout the detector and to reduce by a factor 5x the data before event reconstruction because the data have to be streamed to a permanent storage. Then, the data will be sent through the network to EPNs for event reconstruction and further processing. In the new system, a scheduler between the two clusters is required in order to efficiently propagate jobs and data from FLPs to EPNs. Each FLP node receives collision events which are grouped in time frames spanning 0.1 second. EPN also has to forward the events to an assigned EPN node immediately. Scheduling process and data synchronization must be fast because the delay may cause severe bottleneck and provoke side effects like increasing the buffer space needed on FLPs. In this work, we have adopted Zookeeper, a data synchronization tool, to distribute events schedule (that is created by scheduler) to FLPs.
id cern-1748457
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2014
record_format invenio
spelling cern-17484572019-09-30T06:29:59Zhttp://cds.cern.ch/record/1748457engPumma, SarunyaData Synchronization Method Between FLPs and EPNsComputing and ComputersComputing and ComputersIn the year 2018, the ALICE detectors will be upgraded and the amount of data that will be produced from the detectors will be higher. The data throughput will be approximately 1 TB per second. For this reason, the whole ALICE's system has to be improved. The constraint of the new ALICE experiments is the system should be able to handle a large amount of particles collision events that will be produced from detectors. The data acquisition comprises two computer clusters – First Level Processors (FLP) and Event Processing Nodes (EPN). The two clusters serve different purposes. The FLP cluster is responsible to readout the detector and to reduce by a factor 5x the data before event reconstruction because the data have to be streamed to a permanent storage. Then, the data will be sent through the network to EPNs for event reconstruction and further processing. In the new system, a scheduler between the two clusters is required in order to efficiently propagate jobs and data from FLPs to EPNs. Each FLP node receives collision events which are grouped in time frames spanning 0.1 second. EPN also has to forward the events to an assigned EPN node immediately. Scheduling process and data synchronization must be fast because the delay may cause severe bottleneck and provoke side effects like increasing the buffer space needed on FLPs. In this work, we have adopted Zookeeper, a data synchronization tool, to distribute events schedule (that is created by scheduler) to FLPs. CERN-STUDENTS-Note-2014-016oai:cds.cern.ch:17484572014
spellingShingle Computing and Computers
Computing and Computers
Pumma, Sarunya
Data Synchronization Method Between FLPs and EPNs
title Data Synchronization Method Between FLPs and EPNs
title_full Data Synchronization Method Between FLPs and EPNs
title_fullStr Data Synchronization Method Between FLPs and EPNs
title_full_unstemmed Data Synchronization Method Between FLPs and EPNs
title_short Data Synchronization Method Between FLPs and EPNs
title_sort data synchronization method between flps and epns
topic Computing and Computers
Computing and Computers
url http://cds.cern.ch/record/1748457
work_keys_str_mv AT pummasarunya datasynchronizationmethodbetweenflpsandepns