9 May 2016 Revisiting LSS Analyses in the DESI Era Berkeley … · 2016. 5. 9. · Revisiting LSS...
Transcript of 9 May 2016 Revisiting LSS Analyses in the DESI Era Berkeley … · 2016. 5. 9. · Revisiting LSS...
![Page 1: 9 May 2016 Revisiting LSS Analyses in the DESI Era Berkeley … · 2016. 5. 9. · Revisiting LSS Analyses in the DESI Era Nikhil Padmanabhan Yale Univ. 9 May 2016 Berkeley Cosmology](https://reader033.fdocuments.in/reader033/viewer/2022060916/60a95b8fb1ed913b8d227278/html5/thumbnails/1.jpg)
Revisiting LSS Analyses in the DESI Era
Nikhil Padmanabhan
Yale Univ.
9 M
ay 2
016
Berk
eley
Cos
mol
ogy
w/ Fangzhou Zhu, Martin White, Harrison ZhuarXiv:1512.01241, 1604.01050
![Page 2: 9 May 2016 Revisiting LSS Analyses in the DESI Era Berkeley … · 2016. 5. 9. · Revisiting LSS Analyses in the DESI Era Nikhil Padmanabhan Yale Univ. 9 May 2016 Berkeley Cosmology](https://reader033.fdocuments.in/reader033/viewer/2022060916/60a95b8fb1ed913b8d227278/html5/thumbnails/2.jpg)
Outline• “Golden Age” for galaxy redshift surveys
• Can we capitalize on the forecasted statistical power of these surveys? Are our theories accurate enough? Can our analysis methods achieve the statistical/systematic
precision?
• Three examples The success of BAO reconstruction Redshift weighting for BAO measurements Estimating covariance matrices
9 M
ay 2
016
Berk
eley
Cos
mol
ogy
I will take a galaxy/BAO-centric view, but some of the techniques are more broadly applicable.
![Page 3: 9 May 2016 Revisiting LSS Analyses in the DESI Era Berkeley … · 2016. 5. 9. · Revisiting LSS Analyses in the DESI Era Nikhil Padmanabhan Yale Univ. 9 May 2016 Berkeley Cosmology](https://reader033.fdocuments.in/reader033/viewer/2022060916/60a95b8fb1ed913b8d227278/html5/thumbnails/3.jpg)
The BAO feature in BOSS galaxies
Anderson et al, 2014
8 sigma detection
~1% distance at z~0.55, ~2% at z~0.35
9 M
ay 2
016
Berk
eley
Cos
mol
ogy
![Page 4: 9 May 2016 Revisiting LSS Analyses in the DESI Era Berkeley … · 2016. 5. 9. · Revisiting LSS Analyses in the DESI Era Nikhil Padmanabhan Yale Univ. 9 May 2016 Berkeley Cosmology](https://reader033.fdocuments.in/reader033/viewer/2022060916/60a95b8fb1ed913b8d227278/html5/thumbnails/4.jpg)
The BAO feature in the Ly-A forest
Delubac et al 2014~2% distance measurements at z~2.5
9 M
ay 2
016
Berk
eley
Cos
mol
ogy
![Page 5: 9 May 2016 Revisiting LSS Analyses in the DESI Era Berkeley … · 2016. 5. 9. · Revisiting LSS Analyses in the DESI Era Nikhil Padmanabhan Yale Univ. 9 May 2016 Berkeley Cosmology](https://reader033.fdocuments.in/reader033/viewer/2022060916/60a95b8fb1ed913b8d227278/html5/thumbnails/5.jpg)
A BAO Hubble diagram
Aubourg et al, 2014
9 M
ay 2
016
Berk
eley
Cos
mol
ogy
![Page 6: 9 May 2016 Revisiting LSS Analyses in the DESI Era Berkeley … · 2016. 5. 9. · Revisiting LSS Analyses in the DESI Era Nikhil Padmanabhan Yale Univ. 9 May 2016 Berkeley Cosmology](https://reader033.fdocuments.in/reader033/viewer/2022060916/60a95b8fb1ed913b8d227278/html5/thumbnails/6.jpg)
Measuring Dark Energy
Aubourg et al, 2014
9 M
ay 2
016
Berk
eley
Cos
mol
ogy
![Page 7: 9 May 2016 Revisiting LSS Analyses in the DESI Era Berkeley … · 2016. 5. 9. · Revisiting LSS Analyses in the DESI Era Nikhil Padmanabhan Yale Univ. 9 May 2016 Berkeley Cosmology](https://reader033.fdocuments.in/reader033/viewer/2022060916/60a95b8fb1ed913b8d227278/html5/thumbnails/7.jpg)
The Cosmic Fire Escape
Aubourg et al, 2014
9 M
ay 2
016
Berk
eley
Cos
mol
ogy
![Page 8: 9 May 2016 Revisiting LSS Analyses in the DESI Era Berkeley … · 2016. 5. 9. · Revisiting LSS Analyses in the DESI Era Nikhil Padmanabhan Yale Univ. 9 May 2016 Berkeley Cosmology](https://reader033.fdocuments.in/reader033/viewer/2022060916/60a95b8fb1ed913b8d227278/html5/thumbnails/8.jpg)
BOSS
2029
2027
2025
2023
2021
2017
2015
2013
2019
Dark Energy Experiments: 2013 - 2031
Dark Energy Survey(DES)
Extended BOSS (eBOSS)
HSC imaging
PFS spectroscopy
Dark Energy Spec. Instrument (DESI)
Large Synoptic Survey Telescope (LSST)
Euclid
WFIRST-AFTA
BOSS
HETDEX
2031
Blue = imagingRed = spectroscopy
Weinberg et al, Snowmass 2013… and many others (JPAS,PAU, KIDS, CHIME,..)
9 M
ay 2
016
Berk
eley
Cos
mol
ogy
![Page 9: 9 May 2016 Revisiting LSS Analyses in the DESI Era Berkeley … · 2016. 5. 9. · Revisiting LSS Analyses in the DESI Era Nikhil Padmanabhan Yale Univ. 9 May 2016 Berkeley Cosmology](https://reader033.fdocuments.in/reader033/viewer/2022060916/60a95b8fb1ed913b8d227278/html5/thumbnails/9.jpg)
B. Flaugher
9 M
ay 2
016
Berk
eley
Cos
mol
ogy
![Page 10: 9 May 2016 Revisiting LSS Analyses in the DESI Era Berkeley … · 2016. 5. 9. · Revisiting LSS Analyses in the DESI Era Nikhil Padmanabhan Yale Univ. 9 May 2016 Berkeley Cosmology](https://reader033.fdocuments.in/reader033/viewer/2022060916/60a95b8fb1ed913b8d227278/html5/thumbnails/10.jpg)
The DESI Survey• 2019-2024
• 14000 sq. deg.
• Tracers Bright galaxy survey (r < 19.5, z < 0.4) Red galaxies (z < 1) Emission line galaxies (z < 1.7) Tracer QSOs (1 < z < 3) Lyman-alpha forest Designed to have multiple possible cross correlations
• Imaging DECam data (dec < 30) : 9000 sq.deg Bok, Mosaic data (dec > 30) WISE data
9 M
ay 2
016
Berk
eley
Cos
mol
ogy
![Page 11: 9 May 2016 Revisiting LSS Analyses in the DESI Era Berkeley … · 2016. 5. 9. · Revisiting LSS Analyses in the DESI Era Nikhil Padmanabhan Yale Univ. 9 May 2016 Berkeley Cosmology](https://reader033.fdocuments.in/reader033/viewer/2022060916/60a95b8fb1ed913b8d227278/html5/thumbnails/11.jpg)
The expansion rate in the DESI era
9 M
ay 2
016
Berk
eley
Cos
mol
ogy
DESI CDR
![Page 12: 9 May 2016 Revisiting LSS Analyses in the DESI Era Berkeley … · 2016. 5. 9. · Revisiting LSS Analyses in the DESI Era Nikhil Padmanabhan Yale Univ. 9 May 2016 Berkeley Cosmology](https://reader033.fdocuments.in/reader033/viewer/2022060916/60a95b8fb1ed913b8d227278/html5/thumbnails/12.jpg)
Are we ready for DESI?
• LSS analyses have mostly remained unchanged…
• Built around two-point functions
• Do our analysis methods matter? Yes!
• Start with a successful example : BAO reconstruction
9 M
ay 2
016
Berk
eley
Cos
mol
ogy
![Page 13: 9 May 2016 Revisiting LSS Analyses in the DESI Era Berkeley … · 2016. 5. 9. · Revisiting LSS Analyses in the DESI Era Nikhil Padmanabhan Yale Univ. 9 May 2016 Berkeley Cosmology](https://reader033.fdocuments.in/reader033/viewer/2022060916/60a95b8fb1ed913b8d227278/html5/thumbnails/13.jpg)
Beyond two-point functions
Anderson et al, 2014
8 sigma detection
~1% distance at z~0.55, ~2% at z~0.35
9 M
ay 2
016
Berk
eley
Cos
mol
ogy
![Page 14: 9 May 2016 Revisiting LSS Analyses in the DESI Era Berkeley … · 2016. 5. 9. · Revisiting LSS Analyses in the DESI Era Nikhil Padmanabhan Yale Univ. 9 May 2016 Berkeley Cosmology](https://reader033.fdocuments.in/reader033/viewer/2022060916/60a95b8fb1ed913b8d227278/html5/thumbnails/14.jpg)
BAO reconstruction : A cartoon
9 M
ay 2
016
Berk
eley
Cos
mol
ogy
NP et al, 2012
![Page 15: 9 May 2016 Revisiting LSS Analyses in the DESI Era Berkeley … · 2016. 5. 9. · Revisiting LSS Analyses in the DESI Era Nikhil Padmanabhan Yale Univ. 9 May 2016 Berkeley Cosmology](https://reader033.fdocuments.in/reader033/viewer/2022060916/60a95b8fb1ed913b8d227278/html5/thumbnails/15.jpg)
Reconstruction goes beyond 2-pt
9 M
ay 2
016
Berk
eley
Cos
mol
ogy
Schmittfull et al, 2015
![Page 16: 9 May 2016 Revisiting LSS Analyses in the DESI Era Berkeley … · 2016. 5. 9. · Revisiting LSS Analyses in the DESI Era Nikhil Padmanabhan Yale Univ. 9 May 2016 Berkeley Cosmology](https://reader033.fdocuments.in/reader033/viewer/2022060916/60a95b8fb1ed913b8d227278/html5/thumbnails/16.jpg)
Improvements with BAO reconstruction
9 M
ay 2
016
Berk
eley
Cos
mol
ogy
Anderson et al, 2013
![Page 17: 9 May 2016 Revisiting LSS Analyses in the DESI Era Berkeley … · 2016. 5. 9. · Revisiting LSS Analyses in the DESI Era Nikhil Padmanabhan Yale Univ. 9 May 2016 Berkeley Cosmology](https://reader033.fdocuments.in/reader033/viewer/2022060916/60a95b8fb1ed913b8d227278/html5/thumbnails/17.jpg)
How do I make this figure?
9 M
ay 2
016
Berk
eley
Cos
mol
ogy
![Page 18: 9 May 2016 Revisiting LSS Analyses in the DESI Era Berkeley … · 2016. 5. 9. · Revisiting LSS Analyses in the DESI Era Nikhil Padmanabhan Yale Univ. 9 May 2016 Berkeley Cosmology](https://reader033.fdocuments.in/reader033/viewer/2022060916/60a95b8fb1ed913b8d227278/html5/thumbnails/18.jpg)
Generalizing redshift bins• The challenges of redshift bins BAO distance errors get very non-Gaussian with decreasing
S/N What and how many bins to use? Trade between redshift resolution and S/N
Loss of information at bin boundaries What is the effective redshift of a redshift bin? Covariances between different bins
• Generalizing redshift bins The distance-redshift relationship is smooth Parametrize the distance-redshift relationship Design redshift weights to extract information on these
parameters
9 M
ay 2
016
Berk
eley
Cos
mol
ogy
![Page 19: 9 May 2016 Revisiting LSS Analyses in the DESI Era Berkeley … · 2016. 5. 9. · Revisiting LSS Analyses in the DESI Era Nikhil Padmanabhan Yale Univ. 9 May 2016 Berkeley Cosmology](https://reader033.fdocuments.in/reader033/viewer/2022060916/60a95b8fb1ed913b8d227278/html5/thumbnails/19.jpg)
Optimal weights : a toy model
“correlation function”
“Hubble parameter”
9 M
ay 2
016
Berk
eley
Cos
mol
ogy
![Page 20: 9 May 2016 Revisiting LSS Analyses in the DESI Era Berkeley … · 2016. 5. 9. · Revisiting LSS Analyses in the DESI Era Nikhil Padmanabhan Yale Univ. 9 May 2016 Berkeley Cosmology](https://reader033.fdocuments.in/reader033/viewer/2022060916/60a95b8fb1ed913b8d227278/html5/thumbnails/20.jpg)
Weights optimally recover information
9 M
ay 2
016
Berk
eley
Cos
mol
ogy
![Page 21: 9 May 2016 Revisiting LSS Analyses in the DESI Era Berkeley … · 2016. 5. 9. · Revisiting LSS Analyses in the DESI Era Nikhil Padmanabhan Yale Univ. 9 May 2016 Berkeley Cosmology](https://reader033.fdocuments.in/reader033/viewer/2022060916/60a95b8fb1ed913b8d227278/html5/thumbnails/21.jpg)
Parametrize the distance-z relation
9 M
ay 2
016
Berk
eley
Cos
mol
ogy
• Enforce “smoothness” in distance redshift-relation
• Connect dA and H• Optimized estimators to
estimate these parameters –matched filters
![Page 22: 9 May 2016 Revisiting LSS Analyses in the DESI Era Berkeley … · 2016. 5. 9. · Revisiting LSS Analyses in the DESI Era Nikhil Padmanabhan Yale Univ. 9 May 2016 Berkeley Cosmology](https://reader033.fdocuments.in/reader033/viewer/2022060916/60a95b8fb1ed913b8d227278/html5/thumbnails/22.jpg)
Optimized redshift weights
9 M
ay 2
016
Berk
eley
Cos
mol
ogy
• The first is what we normally measure• Analogy to a matched filter• Conceptually, measure a correlation function in redshift
bins and sum; can be implemented with a small modification to usual paircounters etc
• Heuristic understanding
![Page 23: 9 May 2016 Revisiting LSS Analyses in the DESI Era Berkeley … · 2016. 5. 9. · Revisiting LSS Analyses in the DESI Era Nikhil Padmanabhan Yale Univ. 9 May 2016 Berkeley Cosmology](https://reader033.fdocuments.in/reader033/viewer/2022060916/60a95b8fb1ed913b8d227278/html5/thumbnails/23.jpg)
Sensitivity to model parameters
9 M
ay 2
016
Berk
eley
Cos
mol
ogy
• Explore how correlation functions change with changes in parameters.
• Assume a BOSS like galaxy survey from z=0.2 to 0.7
![Page 24: 9 May 2016 Revisiting LSS Analyses in the DESI Era Berkeley … · 2016. 5. 9. · Revisiting LSS Analyses in the DESI Era Nikhil Padmanabhan Yale Univ. 9 May 2016 Berkeley Cosmology](https://reader033.fdocuments.in/reader033/viewer/2022060916/60a95b8fb1ed913b8d227278/html5/thumbnails/24.jpg)
An example fit
9 M
ay 2
016
Berk
eley
Cos
mol
ogy
One out of 1000 BOSS simulations, over the full redshift range
![Page 25: 9 May 2016 Revisiting LSS Analyses in the DESI Era Berkeley … · 2016. 5. 9. · Revisiting LSS Analyses in the DESI Era Nikhil Padmanabhan Yale Univ. 9 May 2016 Berkeley Cosmology](https://reader033.fdocuments.in/reader033/viewer/2022060916/60a95b8fb1ed913b8d227278/html5/thumbnails/25.jpg)
Estimated parameters and forecasts
9 M
ay 2
016
Berk
eley
Cos
mol
ogy
![Page 26: 9 May 2016 Revisiting LSS Analyses in the DESI Era Berkeley … · 2016. 5. 9. · Revisiting LSS Analyses in the DESI Era Nikhil Padmanabhan Yale Univ. 9 May 2016 Berkeley Cosmology](https://reader033.fdocuments.in/reader033/viewer/2022060916/60a95b8fb1ed913b8d227278/html5/thumbnails/26.jpg)
Independent of pivot redshift
9 M
ay 2
016
Berk
eley
Cos
mol
ogy
Note that the parametrization isn’t z-pivot independent, but the inferred distance redshift relation is.
![Page 27: 9 May 2016 Revisiting LSS Analyses in the DESI Era Berkeley … · 2016. 5. 9. · Revisiting LSS Analyses in the DESI Era Nikhil Padmanabhan Yale Univ. 9 May 2016 Berkeley Cosmology](https://reader033.fdocuments.in/reader033/viewer/2022060916/60a95b8fb1ed913b8d227278/html5/thumbnails/27.jpg)
The method is robust
9 M
ay 2
016
Berk
eley
Cos
mol
ogy
![Page 28: 9 May 2016 Revisiting LSS Analyses in the DESI Era Berkeley … · 2016. 5. 9. · Revisiting LSS Analyses in the DESI Era Nikhil Padmanabhan Yale Univ. 9 May 2016 Berkeley Cosmology](https://reader033.fdocuments.in/reader033/viewer/2022060916/60a95b8fb1ed913b8d227278/html5/thumbnails/28.jpg)
Where do I get my errors from?
9 M
ay 2
016
Berk
eley
Cos
mol
ogy
![Page 29: 9 May 2016 Revisiting LSS Analyses in the DESI Era Berkeley … · 2016. 5. 9. · Revisiting LSS Analyses in the DESI Era Nikhil Padmanabhan Yale Univ. 9 May 2016 Berkeley Cosmology](https://reader033.fdocuments.in/reader033/viewer/2022060916/60a95b8fb1ed913b8d227278/html5/thumbnails/29.jpg)
Covariance matrices• Theory For 2-pt functions, the disconnected part is “straightforward” Eg. Mohammed & Seljak 2014 extending to nonlinearities If you have a good model, use it!
• Sample covariances May be only approach for complicated statistics Slow convergence with number of simulations (~10x number of measurements
at a minimum) Dominant computational cost for current and future surveys This is the approach most cosmological measurements have taken. Can we accelerate this?
9 M
ay 2
016
Berk
eley
Cos
mol
ogy
![Page 30: 9 May 2016 Revisiting LSS Analyses in the DESI Era Berkeley … · 2016. 5. 9. · Revisiting LSS Analyses in the DESI Era Nikhil Padmanabhan Yale Univ. 9 May 2016 Berkeley Cosmology](https://reader033.fdocuments.in/reader033/viewer/2022060916/60a95b8fb1ed913b8d227278/html5/thumbnails/30.jpg)
The structure of the precision matrix
9 M
ay 2
016
Berk
eley
Cos
mol
ogy
Can we use this structure? Requires directly working with precision matrix
![Page 31: 9 May 2016 Revisiting LSS Analyses in the DESI Era Berkeley … · 2016. 5. 9. · Revisiting LSS Analyses in the DESI Era Nikhil Padmanabhan Yale Univ. 9 May 2016 Berkeley Cosmology](https://reader033.fdocuments.in/reader033/viewer/2022060916/60a95b8fb1ed913b8d227278/html5/thumbnails/31.jpg)
This structure is likely generic• Covariance matrix convolution Work in Fourier space
• Decaying correlations between bins C ~ 1/k2
C-1~ k2
Laplaciantri-diagonal matrix
• For decreasing correlations, this structure is relatively generic Approximate as a derivative series
• Can we use this structure? Hard if going through the covariance matrix Solution : directly measure the precision matrix
9 M
ay 2
016
Berk
eley
Cos
mol
ogy
![Page 32: 9 May 2016 Revisiting LSS Analyses in the DESI Era Berkeley … · 2016. 5. 9. · Revisiting LSS Analyses in the DESI Era Nikhil Padmanabhan Yale Univ. 9 May 2016 Berkeley Cosmology](https://reader033.fdocuments.in/reader033/viewer/2022060916/60a95b8fb1ed913b8d227278/html5/thumbnails/32.jpg)
Precision Matrix estimation is linear regression
Simulations
Construct conditional distributions :
ZA ~ ZAc + N
• Linearly regress ZA on ZAc• Pointwise estimate of precision matrix
9 M
ay 2
016
Berk
eley
Cos
mol
ogy
![Page 33: 9 May 2016 Revisiting LSS Analyses in the DESI Era Berkeley … · 2016. 5. 9. · Revisiting LSS Analyses in the DESI Era Nikhil Padmanabhan Yale Univ. 9 May 2016 Berkeley Cosmology](https://reader033.fdocuments.in/reader033/viewer/2022060916/60a95b8fb1ed913b8d227278/html5/thumbnails/33.jpg)
Estimating the precision matrix
9 M
ay 2
016
Berk
eley
Cos
mol
ogy
![Page 34: 9 May 2016 Revisiting LSS Analyses in the DESI Era Berkeley … · 2016. 5. 9. · Revisiting LSS Analyses in the DESI Era Nikhil Padmanabhan Yale Univ. 9 May 2016 Berkeley Cosmology](https://reader033.fdocuments.in/reader033/viewer/2022060916/60a95b8fb1ed913b8d227278/html5/thumbnails/34.jpg)
Pointwise accuracy and scaling
9 M
ay 2
016
Berk
eley
Cos
mol
ogy
Similar behavior for other model-independent metrics
![Page 35: 9 May 2016 Revisiting LSS Analyses in the DESI Era Berkeley … · 2016. 5. 9. · Revisiting LSS Analyses in the DESI Era Nikhil Padmanabhan Yale Univ. 9 May 2016 Berkeley Cosmology](https://reader033.fdocuments.in/reader033/viewer/2022060916/60a95b8fb1ed913b8d227278/html5/thumbnails/35.jpg)
Challenges• Sparsity structure not obvious a priori – can estimate directly from the
data
• Biased estimate of precision matrix : bias-variance tradeoff
• Relevant eigenvectors may not be “sparse” : one can fill in low-rank missing modes.
• How effective this will be is likely to be problem-dependent.
9 M
ay 2
016
Berk
eley
Cos
mol
ogy
![Page 36: 9 May 2016 Revisiting LSS Analyses in the DESI Era Berkeley … · 2016. 5. 9. · Revisiting LSS Analyses in the DESI Era Nikhil Padmanabhan Yale Univ. 9 May 2016 Berkeley Cosmology](https://reader033.fdocuments.in/reader033/viewer/2022060916/60a95b8fb1ed913b8d227278/html5/thumbnails/36.jpg)
Conclusions• “Golden Age” for galaxy redshift surveys
• Three examples The success of BAO reconstruction Redshift weighting for BAO measurements Application to BOSS & eBOSS data Extension to RSD (Ruggeiri et al, 2016)
Estimating covariance matrices Dominant computation cost for current and future surveys May be ways to accelerate these calculations
9 M
ay 2
016
Berk
eley
Cos
mol
ogy