Cargando…

On Bayesian treatment of systematic uncertainties in confidence interval calculation

In high energy physics, a widely used method to treat systematic uncertainties in confidence interval calculations is based on combining a frequentist construction of confidence belts with a Bayesian treatment of systematic uncertainties. In this note we present a study of the coverage of this metho...

Descripción completa

Detalles Bibliográficos
Autores principales: Tegenfeldt, Fredrik, Conrad, Jan
Lenguaje:eng
Publicado: 2004
Materias:
Acceso en línea:https://dx.doi.org/10.1016/j.nima.2004.09.037
http://cds.cern.ch/record/787940
_version_ 1780904446486642688
author Tegenfeldt, Fredrik
Conrad, Jan
author_facet Tegenfeldt, Fredrik
Conrad, Jan
author_sort Tegenfeldt, Fredrik
collection CERN
description In high energy physics, a widely used method to treat systematic uncertainties in confidence interval calculations is based on combining a frequentist construction of confidence belts with a Bayesian treatment of systematic uncertainties. In this note we present a study of the coverage of this method for the standard Likelihood Ratio (aka Feldman & Cousins) construction for a Poisson process with known background and Gaussian or log-Normal distributed uncertainties in the background or signal efficiency. For uncertainties in the signal efficiency of upto 40 % we find over-coverage on the level of 2 to 4 % depending on the size of uncertainties and the region in signal space. Uncertainties in the background generally have smaller effect on the coverage. A considerable smoothing of the coverage curves is observed. A software package is presented which allows fast calculation of the confidence intervals for a variety of assumptions on shape and size of systematic uncertainties for different nuisance parameters. The calculation speed allows experimenters to test the coverage for their specific conditions.
id cern-787940
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2004
record_format invenio
spelling cern-7879402019-09-30T06:29:59Zdoi:10.1016/j.nima.2004.09.037http://cds.cern.ch/record/787940engTegenfeldt, FredrikConrad, JanOn Bayesian treatment of systematic uncertainties in confidence interval calculationOther Fields of PhysicsIn high energy physics, a widely used method to treat systematic uncertainties in confidence interval calculations is based on combining a frequentist construction of confidence belts with a Bayesian treatment of systematic uncertainties. In this note we present a study of the coverage of this method for the standard Likelihood Ratio (aka Feldman & Cousins) construction for a Poisson process with known background and Gaussian or log-Normal distributed uncertainties in the background or signal efficiency. For uncertainties in the signal efficiency of upto 40 % we find over-coverage on the level of 2 to 4 % depending on the size of uncertainties and the region in signal space. Uncertainties in the background generally have smaller effect on the coverage. A considerable smoothing of the coverage curves is observed. A software package is presented which allows fast calculation of the confidence intervals for a variety of assumptions on shape and size of systematic uncertainties for different nuisance parameters. The calculation speed allows experimenters to test the coverage for their specific conditions.physics/0408039oai:cds.cern.ch:7879402004
spellingShingle Other Fields of Physics
Tegenfeldt, Fredrik
Conrad, Jan
On Bayesian treatment of systematic uncertainties in confidence interval calculation
title On Bayesian treatment of systematic uncertainties in confidence interval calculation
title_full On Bayesian treatment of systematic uncertainties in confidence interval calculation
title_fullStr On Bayesian treatment of systematic uncertainties in confidence interval calculation
title_full_unstemmed On Bayesian treatment of systematic uncertainties in confidence interval calculation
title_short On Bayesian treatment of systematic uncertainties in confidence interval calculation
title_sort on bayesian treatment of systematic uncertainties in confidence interval calculation
topic Other Fields of Physics
url https://dx.doi.org/10.1016/j.nima.2004.09.037
http://cds.cern.ch/record/787940
work_keys_str_mv AT tegenfeldtfredrik onbayesiantreatmentofsystematicuncertaintiesinconfidenceintervalcalculation
AT conradjan onbayesiantreatmentofsystematicuncertaintiesinconfidenceintervalcalculation