Cargando…

How big is Big Data? A comprehensive survey of data production, storage, and streaming in science and industry

The contemporary surge in data production is fueled by diverse factors, with contributions from numerous stakeholders across various sectors. Comparing the volumes at play among different big data entities is challenging due to the scarcity of publicly available data. This survey aims to offer a com...

Descripción completa

Detalles Bibliográficos
Autores principales: Clissa, Luca, Lassnig, Mario, Rinaldi, Lorenzo
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10620515/
https://www.ncbi.nlm.nih.gov/pubmed/37928176
http://dx.doi.org/10.3389/fdata.2023.1271639
_version_ 1785130223461728256
author Clissa, Luca
Lassnig, Mario
Rinaldi, Lorenzo
author_facet Clissa, Luca
Lassnig, Mario
Rinaldi, Lorenzo
author_sort Clissa, Luca
collection PubMed
description The contemporary surge in data production is fueled by diverse factors, with contributions from numerous stakeholders across various sectors. Comparing the volumes at play among different big data entities is challenging due to the scarcity of publicly available data. This survey aims to offer a comprehensive perspective on the orders of magnitude involved in yearly data generation by some public and private leading organizations, using an array of online sources for estimation. These estimates are based on meaningful, individual data production metrics and plausible per-unit sizes. The primary objective is to offer insights into the comparative scales of major big data players, their sources, and data production flows, rather than striving for precise measurements or incorporating the latest updates. The results are succinctly conveyed through a visual representation of the relative data generation volumes across these entities.
format Online
Article
Text
id pubmed-10620515
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-106205152023-11-03 How big is Big Data? A comprehensive survey of data production, storage, and streaming in science and industry Clissa, Luca Lassnig, Mario Rinaldi, Lorenzo Front Big Data Big Data The contemporary surge in data production is fueled by diverse factors, with contributions from numerous stakeholders across various sectors. Comparing the volumes at play among different big data entities is challenging due to the scarcity of publicly available data. This survey aims to offer a comprehensive perspective on the orders of magnitude involved in yearly data generation by some public and private leading organizations, using an array of online sources for estimation. These estimates are based on meaningful, individual data production metrics and plausible per-unit sizes. The primary objective is to offer insights into the comparative scales of major big data players, their sources, and data production flows, rather than striving for precise measurements or incorporating the latest updates. The results are succinctly conveyed through a visual representation of the relative data generation volumes across these entities. Frontiers Media S.A. 2023-10-19 /pmc/articles/PMC10620515/ /pubmed/37928176 http://dx.doi.org/10.3389/fdata.2023.1271639 Text en Copyright © 2023 Clissa, Lassnig and Rinaldi. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Big Data
Clissa, Luca
Lassnig, Mario
Rinaldi, Lorenzo
How big is Big Data? A comprehensive survey of data production, storage, and streaming in science and industry
title How big is Big Data? A comprehensive survey of data production, storage, and streaming in science and industry
title_full How big is Big Data? A comprehensive survey of data production, storage, and streaming in science and industry
title_fullStr How big is Big Data? A comprehensive survey of data production, storage, and streaming in science and industry
title_full_unstemmed How big is Big Data? A comprehensive survey of data production, storage, and streaming in science and industry
title_short How big is Big Data? A comprehensive survey of data production, storage, and streaming in science and industry
title_sort how big is big data? a comprehensive survey of data production, storage, and streaming in science and industry
topic Big Data
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10620515/
https://www.ncbi.nlm.nih.gov/pubmed/37928176
http://dx.doi.org/10.3389/fdata.2023.1271639
work_keys_str_mv AT clissaluca howbigisbigdataacomprehensivesurveyofdataproductionstorageandstreaminginscienceandindustry
AT lassnigmario howbigisbigdataacomprehensivesurveyofdataproductionstorageandstreaminginscienceandindustry
AT rinaldilorenzo howbigisbigdataacomprehensivesurveyofdataproductionstorageandstreaminginscienceandindustry