Welcome to the new version of CaltechAUTHORS. Login is currently restricted to library staff. If you notice any issues, please email coda@library.caltech.edu
Published November 15, 2023 | Published
Journal Article Open

Analytic distribution of the optimal cross-correlation statistic for stochastic gravitational-wave-background searches using pulsar timing arrays

Abstract

We show via both analytical calculation and numerical simulation that the optimal cross-correlation statistic (OS) for stochastic gravitational-wave-background (GWB) searches using data from pulsar timing arrays follows a generalized chi-squared (GX2) distribution—i.e., a linear combination of chi-squared distributions with coefficients given by the eigenvalues of the quadratic form defining the statistic. This observation is particularly important for calculating the frequentist statistical significance of a possible GWB detection, which depends on the exact form of the distribution of the OS signal-to-noise ratio ρ̌ ²_(gw)/σ₀ in the absence of GW-induced cross correlations (i.e., the null distribution). Previous discussions of the OS have incorrectly assumed that the analytic null distribution of ρ̌ is well approximated by a zero-mean unit-variance Gaussian distribution. Empirical calculations show that the null distribution of ρ̌ has "tails" which differ significantly from those for a Gaussian distribution but which follow (exactly) a GX2 distribution. Thus, a correct analytical assessment of the statistical significance of a potential detection requires the use of a GX2 distribution.

Copyright and License

© 2023 American Physical Society.

Acknowledgement

J. S. H., P. M. M., J. D. R., and X. S. acknowledge support from the NSF NANOGrav Physics Frontier Center (NSF Grants No. PHY-1430284 and No. PHY-2020265). J. D. R. acknowledges support from start-up funds from Texas Tech University. J. S. H. acknowledges support from start-up funds from Oregon State University. The authors thank Math.StackExchange user River Li, whose answer [26] introduced us to the technique of diagonalization to derive probability distributions for inner products. Lastly, we also thank the authors of [10] for helpful discussions regarding the MatLab code [27] they developed to calculate GX2 distributions.

Files

PhysRevD.108.104050.pdf
Files (569.6 kB)
Name Size Download all
md5:cd26d049ce7600c38d25709898eca369
569.6 kB Preview Download

Additional details

Created:
December 1, 2023
Modified:
December 1, 2023