Statistical analysis of the causes of excess variance in the 21 cm signal power spectra obtained with the Low-Frequency Array

The detection of the 21 cm signal of neutral hydrogen from the Epoch of Reionization (EoR) is challenging due to bright foreground sources, radio frequency interference (RFI), the ionosphere, and instrumental effects. Even after correcting for these effects in the calibration step and applying foreground removal techniques, the remaining residuals in the observed 21 cm power spectra are still above the thermal noise, which is referred to as the "excess variance." We study potential causes of this excess variance based on 13 nights of data obtained with the Low-Frequency Array (LOFAR). We focused on the impact of gain errors, the sky model, and ionospheric effects on the excess variance by correlating the relevant parameters such as the gain variance over time or frequency, local sidereal time (LST), diffractive scale, and phase structure-function slope with the level of excess variance. Our analysis shows that excess variance has an LST dependence, which is related to the power from the sky. And the simulated Stokes I power spectra from bright sources and the excess variance show a similar progression over LST with the minimum power appearing at LST bin 6h to 9h. This LST dependence is also present in sky images of the residual Stokes I of the observations. In very-wide sky images, we demonstrate that the extra power comes exactly from the direction of bright and distant sources Cassiopeia A and Cygnus A with the array beam patterns. These results suggest that the level of excess variance in the 21 cm signal power spectra is related to sky effects and, hence, it depends on LST. In particular, very bright and distant sources such as Cassiopeia A and Cygnus A can dominate the effect. This is in line with earlier studies and offers a path forward toward a solution since the correlation between the sky-related effects and the excess variance is non-negligible.Comment: 29 pages, 14 figures, accepted for publication in A&