Autopsy of measurements with the ATLAS detector at the LHC

A lot of attention has been devoted to the study of discoveries in high energy physics (HEP), but less on measurements aiming at improving an existing theory like the standard model of particle physics, getting more precise values for the parameters of the theory or establishing relationships between them. This paper provides a detailed and critical study of how measurements are performed in recent HEP experiments, taking examples from differential cross section measurements with the ATLAS detector at the LHC. This study will be used to provide an elucidation of the concept of event used in HEP, in order to determine what constitutes an observation and what does not. It will highlight the essential place taken by theory-ladenness in order to produce observational facts, and will show how uncertainty and sensitivity estimates constitute an operational approach to robustness, inside the practice of science, avoiding potential circularity problem traditionally implied by theory-ladenness. This is in contrast to robustness analyses typically considered in the literature. A careful analysis of systematic uncertainty estimates and of statistical tests used to set empirical conclusions from the observations will however demonstrate that quantitative statements obtained from these statistical tests cannot be more than simple guiding arguments for the production of knowledge, but do not determine it. This indicates that the frontier between theory and observation is blurry and that the dichotomy theory-experiment should be revised.