Cargando…
Fewer Mocks and Less Noise: Reducing the Dimensionality of Cosmological Observables with Subspace Projections
Creating accurate and low-noise covariance matrices represents a formidable challenge in modern-day cosmology. We present a formalism to compress arbitrary observables into a small number of bins by projection into a model-specific subspace that minimizes the prior-averaged log-likelihood error. The...
Autores principales: | , , , , |
---|---|
Lenguaje: | eng |
Publicado: |
2020
|
Materias: | |
Acceso en línea: | https://dx.doi.org/10.1103/PhysRevD.103.043508 http://cds.cern.ch/record/2730079 |
_version_ | 1780966471231340544 |
---|---|
author | Philcox, Oliver H.E. Ivanov, Mikhail M. Zaldarriaga, Matias Simonovic, Marko Schmittfull, Marcel |
author_facet | Philcox, Oliver H.E. Ivanov, Mikhail M. Zaldarriaga, Matias Simonovic, Marko Schmittfull, Marcel |
author_sort | Philcox, Oliver H.E. |
collection | CERN |
description | Creating accurate and low-noise covariance matrices represents a formidable challenge in modern-day cosmology. We present a formalism to compress arbitrary observables into a small number of bins by projection into a model-specific subspace that minimizes the prior-averaged log-likelihood error. The lower dimensionality leads to a dramatic reduction in covariance matrix noise, significantly reducing the number of mocks that need to be computed. Given a theory model, a set of priors, and a simple model of the covariance, our method works by using singular value decompositions to construct a basis for the observable that is close to Euclidean; by restricting to the first few basis vectors, we can capture almost all the constraining power in a lower-dimensional subspace. Unlike conventional approaches, the method can be tailored for specific analyses and captures nonlinearities that are not present in the Fisher matrix, ensuring that the full likelihood can be reproduced. The procedure is validated with full-shape analyses of power spectra from Baryon Oscillation Spectroscopic Survey (BOSS) DR12 mock catalogs, showing that the 96-bin power spectra can be replaced by 12 subspace coefficients without biasing the output cosmology; this allows for accurate parameter inference using only ∼100 mocks. Such decompositions facilitate accurate testing of power spectrum covariances; for the largest BOSS data chunk, we find the following: (a) analytic covariances provide accurate models (with or without trispectrum terms); and (b) using the sample covariance from the MultiDark-Patchy mocks incurs a ∼0.5σ shift in Ωm, unless the subspace projection is applied. The method is easily extended to higher order statistics; the ∼2000-bin bispectrum can be compressed into only ∼10 coefficients, allowing for accurate analyses using few mocks and without having to increase the bin sizes. |
id | cern-2730079 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2020 |
record_format | invenio |
spelling | cern-27300792023-10-04T06:02:03Zdoi:10.1103/PhysRevD.103.043508http://cds.cern.ch/record/2730079engPhilcox, Oliver H.E.Ivanov, Mikhail M.Zaldarriaga, MatiasSimonovic, MarkoSchmittfull, MarcelFewer Mocks and Less Noise: Reducing the Dimensionality of Cosmological Observables with Subspace Projectionsphysics.data-anOther Fields of Physicshep-thParticle Physics - Theoryastro-ph.IMAstrophysics and Astronomyastro-ph.COAstrophysics and AstronomyCreating accurate and low-noise covariance matrices represents a formidable challenge in modern-day cosmology. We present a formalism to compress arbitrary observables into a small number of bins by projection into a model-specific subspace that minimizes the prior-averaged log-likelihood error. The lower dimensionality leads to a dramatic reduction in covariance matrix noise, significantly reducing the number of mocks that need to be computed. Given a theory model, a set of priors, and a simple model of the covariance, our method works by using singular value decompositions to construct a basis for the observable that is close to Euclidean; by restricting to the first few basis vectors, we can capture almost all the constraining power in a lower-dimensional subspace. Unlike conventional approaches, the method can be tailored for specific analyses and captures nonlinearities that are not present in the Fisher matrix, ensuring that the full likelihood can be reproduced. The procedure is validated with full-shape analyses of power spectra from Baryon Oscillation Spectroscopic Survey (BOSS) DR12 mock catalogs, showing that the 96-bin power spectra can be replaced by 12 subspace coefficients without biasing the output cosmology; this allows for accurate parameter inference using only ∼100 mocks. Such decompositions facilitate accurate testing of power spectrum covariances; for the largest BOSS data chunk, we find the following: (a) analytic covariances provide accurate models (with or without trispectrum terms); and (b) using the sample covariance from the MultiDark-Patchy mocks incurs a ∼0.5σ shift in Ωm, unless the subspace projection is applied. The method is easily extended to higher order statistics; the ∼2000-bin bispectrum can be compressed into only ∼10 coefficients, allowing for accurate analyses using few mocks and without having to increase the bin sizes.Creating accurate and low-noise covariance matrices represents a formidable challenge in modern-day cosmology. We present a formalism to compress arbitrary observables into a small number of bins by projection into a model-specific subspace that minimizes the prior-averaged log-likelihood error. The lower dimensionality leads to a dramatic reduction in covariance matrix noise, significantly reducing the number of mocks that need to be computed. Given a theory model, a set of priors, and a simple model of the covariance, our method works by using singular value decompositions to construct a basis for the observable that is close to Euclidean; by restricting to the first few basis vectors, we can capture almost all the constraining power in a lower-dimensional subspace. Unlike conventional approaches, the method can be tailored for specific analyses and captures non-linearities that are not present in the Fisher matrix, ensuring that the full likelihood can be reproduced. The procedure is validated with full-shape analyses of power spectra from BOSS DR12 mock catalogs, showing that the 96-bin power spectra can be replaced by 12 subspace coefficients without biasing the output cosmology; this allows for accurate parameter inference using only $\sim 100$ mocks. Such decompositions facilitate accurate testing of power spectrum covariances; for the largest BOSS data chunk, we find that: (a) analytic covariances provide accurate models (with or without trispectrum terms); and (b) using the sample covariance from the MultiDark-Patchy mocks incurs a $\sim 0.5\sigma$ shift in $\Omega_m$, unless the subspace projection is applied. The method is easily extended to higher order statistics; the $\sim 2000$-bin bispectrum can be compressed into only $\sim 10$ coefficients, allowing for accurate analyses using few mocks and without having to increase the bin sizes.arXiv:2009.03311CERN-TH-2020-146INR-TH-2020-037oai:cds.cern.ch:27300792020-09-07 |
spellingShingle | physics.data-an Other Fields of Physics hep-th Particle Physics - Theory astro-ph.IM Astrophysics and Astronomy astro-ph.CO Astrophysics and Astronomy Philcox, Oliver H.E. Ivanov, Mikhail M. Zaldarriaga, Matias Simonovic, Marko Schmittfull, Marcel Fewer Mocks and Less Noise: Reducing the Dimensionality of Cosmological Observables with Subspace Projections |
title | Fewer Mocks and Less Noise: Reducing the Dimensionality of Cosmological Observables with Subspace Projections |
title_full | Fewer Mocks and Less Noise: Reducing the Dimensionality of Cosmological Observables with Subspace Projections |
title_fullStr | Fewer Mocks and Less Noise: Reducing the Dimensionality of Cosmological Observables with Subspace Projections |
title_full_unstemmed | Fewer Mocks and Less Noise: Reducing the Dimensionality of Cosmological Observables with Subspace Projections |
title_short | Fewer Mocks and Less Noise: Reducing the Dimensionality of Cosmological Observables with Subspace Projections |
title_sort | fewer mocks and less noise: reducing the dimensionality of cosmological observables with subspace projections |
topic | physics.data-an Other Fields of Physics hep-th Particle Physics - Theory astro-ph.IM Astrophysics and Astronomy astro-ph.CO Astrophysics and Astronomy |
url | https://dx.doi.org/10.1103/PhysRevD.103.043508 http://cds.cern.ch/record/2730079 |
work_keys_str_mv | AT philcoxoliverhe fewermocksandlessnoisereducingthedimensionalityofcosmologicalobservableswithsubspaceprojections AT ivanovmikhailm fewermocksandlessnoisereducingthedimensionalityofcosmologicalobservableswithsubspaceprojections AT zaldarriagamatias fewermocksandlessnoisereducingthedimensionalityofcosmologicalobservableswithsubspaceprojections AT simonovicmarko fewermocksandlessnoisereducingthedimensionalityofcosmologicalobservableswithsubspaceprojections AT schmittfullmarcel fewermocksandlessnoisereducingthedimensionalityofcosmologicalobservableswithsubspaceprojections |