Cargando…

Fewer Mocks and Less Noise: Reducing the Dimensionality of Cosmological Observables with Subspace Projections

Creating accurate and low-noise covariance matrices represents a formidable challenge in modern-day cosmology. We present a formalism to compress arbitrary observables into a small number of bins by projection into a model-specific subspace that minimizes the prior-averaged log-likelihood error. The...

Descripción completa

Detalles Bibliográficos
Autores principales: Philcox, Oliver H.E., Ivanov, Mikhail M., Zaldarriaga, Matias, Simonovic, Marko, Schmittfull, Marcel
Lenguaje:eng
Publicado: 2020
Materias:
Acceso en línea:https://dx.doi.org/10.1103/PhysRevD.103.043508
http://cds.cern.ch/record/2730079
_version_ 1780966471231340544
author Philcox, Oliver H.E.
Ivanov, Mikhail M.
Zaldarriaga, Matias
Simonovic, Marko
Schmittfull, Marcel
author_facet Philcox, Oliver H.E.
Ivanov, Mikhail M.
Zaldarriaga, Matias
Simonovic, Marko
Schmittfull, Marcel
author_sort Philcox, Oliver H.E.
collection CERN
description Creating accurate and low-noise covariance matrices represents a formidable challenge in modern-day cosmology. We present a formalism to compress arbitrary observables into a small number of bins by projection into a model-specific subspace that minimizes the prior-averaged log-likelihood error. The lower dimensionality leads to a dramatic reduction in covariance matrix noise, significantly reducing the number of mocks that need to be computed. Given a theory model, a set of priors, and a simple model of the covariance, our method works by using singular value decompositions to construct a basis for the observable that is close to Euclidean; by restricting to the first few basis vectors, we can capture almost all the constraining power in a lower-dimensional subspace. Unlike conventional approaches, the method can be tailored for specific analyses and captures nonlinearities that are not present in the Fisher matrix, ensuring that the full likelihood can be reproduced. The procedure is validated with full-shape analyses of power spectra from Baryon Oscillation Spectroscopic Survey (BOSS) DR12 mock catalogs, showing that the 96-bin power spectra can be replaced by 12 subspace coefficients without biasing the output cosmology; this allows for accurate parameter inference using only ∼100 mocks. Such decompositions facilitate accurate testing of power spectrum covariances; for the largest BOSS data chunk, we find the following: (a) analytic covariances provide accurate models (with or without trispectrum terms); and (b) using the sample covariance from the MultiDark-Patchy mocks incurs a ∼0.5σ shift in Ωm, unless the subspace projection is applied. The method is easily extended to higher order statistics; the ∼2000-bin bispectrum can be compressed into only ∼10 coefficients, allowing for accurate analyses using few mocks and without having to increase the bin sizes.
id cern-2730079
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2020
record_format invenio
spelling cern-27300792023-10-04T06:02:03Zdoi:10.1103/PhysRevD.103.043508http://cds.cern.ch/record/2730079engPhilcox, Oliver H.E.Ivanov, Mikhail M.Zaldarriaga, MatiasSimonovic, MarkoSchmittfull, MarcelFewer Mocks and Less Noise: Reducing the Dimensionality of Cosmological Observables with Subspace Projectionsphysics.data-anOther Fields of Physicshep-thParticle Physics - Theoryastro-ph.IMAstrophysics and Astronomyastro-ph.COAstrophysics and AstronomyCreating accurate and low-noise covariance matrices represents a formidable challenge in modern-day cosmology. We present a formalism to compress arbitrary observables into a small number of bins by projection into a model-specific subspace that minimizes the prior-averaged log-likelihood error. The lower dimensionality leads to a dramatic reduction in covariance matrix noise, significantly reducing the number of mocks that need to be computed. Given a theory model, a set of priors, and a simple model of the covariance, our method works by using singular value decompositions to construct a basis for the observable that is close to Euclidean; by restricting to the first few basis vectors, we can capture almost all the constraining power in a lower-dimensional subspace. Unlike conventional approaches, the method can be tailored for specific analyses and captures nonlinearities that are not present in the Fisher matrix, ensuring that the full likelihood can be reproduced. The procedure is validated with full-shape analyses of power spectra from Baryon Oscillation Spectroscopic Survey (BOSS) DR12 mock catalogs, showing that the 96-bin power spectra can be replaced by 12 subspace coefficients without biasing the output cosmology; this allows for accurate parameter inference using only ∼100 mocks. Such decompositions facilitate accurate testing of power spectrum covariances; for the largest BOSS data chunk, we find the following: (a) analytic covariances provide accurate models (with or without trispectrum terms); and (b) using the sample covariance from the MultiDark-Patchy mocks incurs a ∼0.5σ shift in Ωm, unless the subspace projection is applied. The method is easily extended to higher order statistics; the ∼2000-bin bispectrum can be compressed into only ∼10 coefficients, allowing for accurate analyses using few mocks and without having to increase the bin sizes.Creating accurate and low-noise covariance matrices represents a formidable challenge in modern-day cosmology. We present a formalism to compress arbitrary observables into a small number of bins by projection into a model-specific subspace that minimizes the prior-averaged log-likelihood error. The lower dimensionality leads to a dramatic reduction in covariance matrix noise, significantly reducing the number of mocks that need to be computed. Given a theory model, a set of priors, and a simple model of the covariance, our method works by using singular value decompositions to construct a basis for the observable that is close to Euclidean; by restricting to the first few basis vectors, we can capture almost all the constraining power in a lower-dimensional subspace. Unlike conventional approaches, the method can be tailored for specific analyses and captures non-linearities that are not present in the Fisher matrix, ensuring that the full likelihood can be reproduced. The procedure is validated with full-shape analyses of power spectra from BOSS DR12 mock catalogs, showing that the 96-bin power spectra can be replaced by 12 subspace coefficients without biasing the output cosmology; this allows for accurate parameter inference using only $\sim 100$ mocks. Such decompositions facilitate accurate testing of power spectrum covariances; for the largest BOSS data chunk, we find that: (a) analytic covariances provide accurate models (with or without trispectrum terms); and (b) using the sample covariance from the MultiDark-Patchy mocks incurs a $\sim 0.5\sigma$ shift in $\Omega_m$, unless the subspace projection is applied. The method is easily extended to higher order statistics; the $\sim 2000$-bin bispectrum can be compressed into only $\sim 10$ coefficients, allowing for accurate analyses using few mocks and without having to increase the bin sizes.arXiv:2009.03311CERN-TH-2020-146INR-TH-2020-037oai:cds.cern.ch:27300792020-09-07
spellingShingle physics.data-an
Other Fields of Physics
hep-th
Particle Physics - Theory
astro-ph.IM
Astrophysics and Astronomy
astro-ph.CO
Astrophysics and Astronomy
Philcox, Oliver H.E.
Ivanov, Mikhail M.
Zaldarriaga, Matias
Simonovic, Marko
Schmittfull, Marcel
Fewer Mocks and Less Noise: Reducing the Dimensionality of Cosmological Observables with Subspace Projections
title Fewer Mocks and Less Noise: Reducing the Dimensionality of Cosmological Observables with Subspace Projections
title_full Fewer Mocks and Less Noise: Reducing the Dimensionality of Cosmological Observables with Subspace Projections
title_fullStr Fewer Mocks and Less Noise: Reducing the Dimensionality of Cosmological Observables with Subspace Projections
title_full_unstemmed Fewer Mocks and Less Noise: Reducing the Dimensionality of Cosmological Observables with Subspace Projections
title_short Fewer Mocks and Less Noise: Reducing the Dimensionality of Cosmological Observables with Subspace Projections
title_sort fewer mocks and less noise: reducing the dimensionality of cosmological observables with subspace projections
topic physics.data-an
Other Fields of Physics
hep-th
Particle Physics - Theory
astro-ph.IM
Astrophysics and Astronomy
astro-ph.CO
Astrophysics and Astronomy
url https://dx.doi.org/10.1103/PhysRevD.103.043508
http://cds.cern.ch/record/2730079
work_keys_str_mv AT philcoxoliverhe fewermocksandlessnoisereducingthedimensionalityofcosmologicalobservableswithsubspaceprojections
AT ivanovmikhailm fewermocksandlessnoisereducingthedimensionalityofcosmologicalobservableswithsubspaceprojections
AT zaldarriagamatias fewermocksandlessnoisereducingthedimensionalityofcosmologicalobservableswithsubspaceprojections
AT simonovicmarko fewermocksandlessnoisereducingthedimensionalityofcosmologicalobservableswithsubspaceprojections
AT schmittfullmarcel fewermocksandlessnoisereducingthedimensionalityofcosmologicalobservableswithsubspaceprojections