Cargando…
Simple and statistically sound recommendations for analysing physical theories
Physical theories that depend on many parameters or are tested against data from many different experiments pose unique challenges to statistical inference. Many models in particle physics, astrophysics and cosmology fall into one or both of these categories. These issues are often sidestepped with...
Autores principales: | , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , |
---|---|
Lenguaje: | eng |
Publicado: |
2020
|
Materias: | |
Acceso en línea: | https://dx.doi.org/10.1088/1361-6633/ac60ac http://cds.cern.ch/record/2751421 |
_version_ | 1780969187388162048 |
---|---|
author | AbdusSalam, Shehu S. Agocs, Fruzsina J. Allanach, Benjamin C. Athron, Peter Balázs, Csaba Bagnaschi, Emanuele Bechtle, Philip Buchmueller, Oliver Beniwal, Ankit Bhom, Jihyun Bloor, Sanjay Bringmann, Torsten Buckley, Andy Butter, Anja Camargo-Molina, José Eliel Chrzaszcz, Marcin Conrad, Jan Cornell, Jonathan M. Danninger, Matthias de Blas, Jorge De Roeck, Albert Desch, Klaus Dolan, Matthew Dreiner, Herbert Eberhardt, Otto Ellis, John Farmer, Ben Fedele, Marco Flächer, Henning Fowlie, Andrew Gonzalo, Tomás E. Grace, Philip Hamer, Matthias Handley, Will Harz, Julia Heinemeyer, Sven Hoof, Sebastian Hotinli, Selim Jackson, Paul Kahlhoefer, Felix Kowalska, Kamila Krämer, Michael Kvellestad, Anders Lucio Martinez, Miriam Mahmoudi, Farvah Martinez Santos, Diego Martinez, Gregory D. Mishima, Satoshi Olive, Keith Paul, Ayan Prim, Markus Tobias Porod, Werner Raklev, Are Renk, Janina J. Rogan, Christopher Roszkowski, Leszek Ruiz de Austri, Roberto Sakurai, Kazuki Scaffidi, Andre Scott, Pat Sessolo, Enrico Maria Stefaniak, Tim Stöcker, Patrick Su, Wei Trojanowski, Sebastian Trotta, Roberto Tsai, Yue-Lin Sming Van den Abeele, Jeriek Valli, Mauro Vincent, Aaron C. Weiglein, Georg White, Martin Wienemann, Peter Wu, Lei Zhang, Yang |
author_facet | AbdusSalam, Shehu S. Agocs, Fruzsina J. Allanach, Benjamin C. Athron, Peter Balázs, Csaba Bagnaschi, Emanuele Bechtle, Philip Buchmueller, Oliver Beniwal, Ankit Bhom, Jihyun Bloor, Sanjay Bringmann, Torsten Buckley, Andy Butter, Anja Camargo-Molina, José Eliel Chrzaszcz, Marcin Conrad, Jan Cornell, Jonathan M. Danninger, Matthias de Blas, Jorge De Roeck, Albert Desch, Klaus Dolan, Matthew Dreiner, Herbert Eberhardt, Otto Ellis, John Farmer, Ben Fedele, Marco Flächer, Henning Fowlie, Andrew Gonzalo, Tomás E. Grace, Philip Hamer, Matthias Handley, Will Harz, Julia Heinemeyer, Sven Hoof, Sebastian Hotinli, Selim Jackson, Paul Kahlhoefer, Felix Kowalska, Kamila Krämer, Michael Kvellestad, Anders Lucio Martinez, Miriam Mahmoudi, Farvah Martinez Santos, Diego Martinez, Gregory D. Mishima, Satoshi Olive, Keith Paul, Ayan Prim, Markus Tobias Porod, Werner Raklev, Are Renk, Janina J. Rogan, Christopher Roszkowski, Leszek Ruiz de Austri, Roberto Sakurai, Kazuki Scaffidi, Andre Scott, Pat Sessolo, Enrico Maria Stefaniak, Tim Stöcker, Patrick Su, Wei Trojanowski, Sebastian Trotta, Roberto Tsai, Yue-Lin Sming Van den Abeele, Jeriek Valli, Mauro Vincent, Aaron C. Weiglein, Georg White, Martin Wienemann, Peter Wu, Lei Zhang, Yang |
author_sort | AbdusSalam, Shehu S. |
collection | CERN |
description | Physical theories that depend on many parameters or are tested against data from many different experiments pose unique challenges to statistical inference. Many models in particle physics, astrophysics and cosmology fall into one or both of these categories. These issues are often sidestepped with statistically unsound ad hoc methods, involving intersection of parameter intervals estimated by multiple experiments, and random or grid sampling of model parameters. Whilst these methods are easy to apply, they exhibit pathologies even in low-dimensional parameter spaces, and quickly become problematic to use and interpret in higher dimensions. In this article we give clear guidance for going beyond these procedures, suggesting where possible simple methods for performing statistically sound inference, and recommendations of readily-available software tools and standards that can assist in doing so. Our aim is to provide any physicists lacking comprehensive statistical training with recommendations for reaching correct scientific conclusions, with only a modest increase in analysis burden. Our examples can be reproduced with the code publicly available at Zenodo. |
id | cern-2751421 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2020 |
record_format | invenio |
spelling | cern-27514212023-09-29T02:09:00Zdoi:10.1088/1361-6633/ac60achttp://cds.cern.ch/record/2751421engAbdusSalam, Shehu S.Agocs, Fruzsina J.Allanach, Benjamin C.Athron, PeterBalázs, CsabaBagnaschi, EmanueleBechtle, PhilipBuchmueller, OliverBeniwal, AnkitBhom, JihyunBloor, SanjayBringmann, TorstenBuckley, AndyButter, AnjaCamargo-Molina, José ElielChrzaszcz, MarcinConrad, JanCornell, Jonathan M.Danninger, Matthiasde Blas, JorgeDe Roeck, AlbertDesch, KlausDolan, MatthewDreiner, HerbertEberhardt, OttoEllis, JohnFarmer, BenFedele, MarcoFlächer, HenningFowlie, AndrewGonzalo, Tomás E.Grace, PhilipHamer, MatthiasHandley, WillHarz, JuliaHeinemeyer, SvenHoof, SebastianHotinli, SelimJackson, PaulKahlhoefer, FelixKowalska, KamilaKrämer, MichaelKvellestad, AndersLucio Martinez, MiriamMahmoudi, FarvahMartinez Santos, DiegoMartinez, Gregory D.Mishima, SatoshiOlive, KeithPaul, AyanPrim, Markus TobiasPorod, WernerRaklev, AreRenk, Janina J.Rogan, ChristopherRoszkowski, LeszekRuiz de Austri, RobertoSakurai, KazukiScaffidi, AndreScott, PatSessolo, Enrico MariaStefaniak, TimStöcker, PatrickSu, WeiTrojanowski, SebastianTrotta, RobertoTsai, Yue-Lin SmingVan den Abeele, JeriekValli, MauroVincent, Aaron C.Weiglein, GeorgWhite, MartinWienemann, PeterWu, LeiZhang, YangSimple and statistically sound recommendations for analysing physical theoriesphysics.data-anOther Fields of Physicshep-exParticle Physics - Experimentastro-ph.COAstrophysics and Astronomyhep-phParticle Physics - PhenomenologyPhysical theories that depend on many parameters or are tested against data from many different experiments pose unique challenges to statistical inference. Many models in particle physics, astrophysics and cosmology fall into one or both of these categories. These issues are often sidestepped with statistically unsound ad hoc methods, involving intersection of parameter intervals estimated by multiple experiments, and random or grid sampling of model parameters. Whilst these methods are easy to apply, they exhibit pathologies even in low-dimensional parameter spaces, and quickly become problematic to use and interpret in higher dimensions. In this article we give clear guidance for going beyond these procedures, suggesting where possible simple methods for performing statistically sound inference, and recommendations of readily-available software tools and standards that can assist in doing so. Our aim is to provide any physicists lacking comprehensive statistical training with recommendations for reaching correct scientific conclusions, with only a modest increase in analysis burden. Our examples can be reproduced with the code publicly available at Zenodo.Physical theories that depend on many parameters or are tested against data from many different experiments pose unique challenges to statistical inference. Many models in particle physics, astrophysics and cosmology fall into one or both of these categories. These issues are often sidestepped with statistically unsound ad hoc methods, involving intersection of parameter intervals estimated by multiple experiments, and random or grid sampling of model parameters. Whilst these methods are easy to apply, they exhibit pathologies even in low-dimensional parameter spaces, and quickly become problematic to use and interpret in higher dimensions. In this article we give clear guidance for going beyond these procedures, suggesting where possible simple methods for performing statistically sound inference, and recommendations of readily-available software tools and standards that can assist in doing so. Our aim is to provide any physicists lacking comprehensive statistical training with recommendations for reaching correct scientific conclusions, with only a modest increase in analysis burden. Our examples can be reproduced with the code publicly available at https://doi.org/10.5281/zenodo.4322283.arXiv:2012.09874PSI-PR-20-23BONN-TH-2020-11CP3-20-59KCL-PH-TH/2020-75, P3H-20-080TTP20-044TUM-HEP-1310/20IFT-UAM/CSIC-20-180TTK-20-47, CERN-TH-2020-215FTPI-MINN-20-36UMN-TH-4005/20HU-EP-20/37DESY 20-222, ADP-20-33/T1143DESY-20-222Imperial/TP/2020/RT/04UCI-TR-2020-19gambit-review-2020oai:cds.cern.ch:27514212020-12-17 |
spellingShingle | physics.data-an Other Fields of Physics hep-ex Particle Physics - Experiment astro-ph.CO Astrophysics and Astronomy hep-ph Particle Physics - Phenomenology AbdusSalam, Shehu S. Agocs, Fruzsina J. Allanach, Benjamin C. Athron, Peter Balázs, Csaba Bagnaschi, Emanuele Bechtle, Philip Buchmueller, Oliver Beniwal, Ankit Bhom, Jihyun Bloor, Sanjay Bringmann, Torsten Buckley, Andy Butter, Anja Camargo-Molina, José Eliel Chrzaszcz, Marcin Conrad, Jan Cornell, Jonathan M. Danninger, Matthias de Blas, Jorge De Roeck, Albert Desch, Klaus Dolan, Matthew Dreiner, Herbert Eberhardt, Otto Ellis, John Farmer, Ben Fedele, Marco Flächer, Henning Fowlie, Andrew Gonzalo, Tomás E. Grace, Philip Hamer, Matthias Handley, Will Harz, Julia Heinemeyer, Sven Hoof, Sebastian Hotinli, Selim Jackson, Paul Kahlhoefer, Felix Kowalska, Kamila Krämer, Michael Kvellestad, Anders Lucio Martinez, Miriam Mahmoudi, Farvah Martinez Santos, Diego Martinez, Gregory D. Mishima, Satoshi Olive, Keith Paul, Ayan Prim, Markus Tobias Porod, Werner Raklev, Are Renk, Janina J. Rogan, Christopher Roszkowski, Leszek Ruiz de Austri, Roberto Sakurai, Kazuki Scaffidi, Andre Scott, Pat Sessolo, Enrico Maria Stefaniak, Tim Stöcker, Patrick Su, Wei Trojanowski, Sebastian Trotta, Roberto Tsai, Yue-Lin Sming Van den Abeele, Jeriek Valli, Mauro Vincent, Aaron C. Weiglein, Georg White, Martin Wienemann, Peter Wu, Lei Zhang, Yang Simple and statistically sound recommendations for analysing physical theories |
title | Simple and statistically sound recommendations for analysing physical theories |
title_full | Simple and statistically sound recommendations for analysing physical theories |
title_fullStr | Simple and statistically sound recommendations for analysing physical theories |
title_full_unstemmed | Simple and statistically sound recommendations for analysing physical theories |
title_short | Simple and statistically sound recommendations for analysing physical theories |
title_sort | simple and statistically sound recommendations for analysing physical theories |
topic | physics.data-an Other Fields of Physics hep-ex Particle Physics - Experiment astro-ph.CO Astrophysics and Astronomy hep-ph Particle Physics - Phenomenology |
url | https://dx.doi.org/10.1088/1361-6633/ac60ac http://cds.cern.ch/record/2751421 |
work_keys_str_mv | AT abdussalamshehus simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT agocsfruzsinaj simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT allanachbenjaminc simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT athronpeter simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT balazscsaba simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT bagnaschiemanuele simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT bechtlephilip simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT buchmuelleroliver simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT beniwalankit simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT bhomjihyun simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT bloorsanjay simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT bringmanntorsten simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT buckleyandy simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT butteranja simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT camargomolinajoseeliel simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT chrzaszczmarcin simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT conradjan simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT cornelljonathanm simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT danningermatthias simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT deblasjorge simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT deroeckalbert simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT deschklaus simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT dolanmatthew simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT dreinerherbert simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT eberhardtotto simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT ellisjohn simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT farmerben simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT fedelemarco simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT flacherhenning simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT fowlieandrew simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT gonzalotomase simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT gracephilip simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT hamermatthias simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT handleywill simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT harzjulia simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT heinemeyersven simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT hoofsebastian simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT hotinliselim simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT jacksonpaul simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT kahlhoeferfelix simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT kowalskakamila simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT kramermichael simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT kvellestadanders simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT luciomartinezmiriam simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT mahmoudifarvah simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT martinezsantosdiego simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT martinezgregoryd simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT mishimasatoshi simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT olivekeith simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT paulayan simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT primmarkustobias simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT porodwerner simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT raklevare simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT renkjaninaj simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT roganchristopher simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT roszkowskileszek simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT ruizdeaustriroberto simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT sakuraikazuki simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT scaffidiandre simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT scottpat simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT sessoloenricomaria simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT stefaniaktim simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT stockerpatrick simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT suwei simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT trojanowskisebastian simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT trottaroberto simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT tsaiyuelinsming simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT vandenabeelejeriek simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT vallimauro simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT vincentaaronc simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT weigleingeorg simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT whitemartin simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT wienemannpeter simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT wulei simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories AT zhangyang simpleandstatisticallysoundrecommendationsforanalysingphysicaltheories |