Kavli Affiliate: Jacqueline N. Hewitt
| First 5 Authors: Paul La Plante, Peter K. G. Williams, Matthew Kolopanis, Joshua S. Dillon, Adam P. Beardsley
| Summary:
As current- and next-generation astronomical instruments come online, they
will generate an unprecedented deluge of data. Analyzing these data in real
time presents unique conceptual and computational challenges, and their
long-term storage and archiving is scientifically essential for generating
reliable, reproducible results. We present here the real-time processing (RTP)
system for the Hydrogen Epoch of Reionization Array (HERA), a radio
interferometer endeavoring to provide the first detection of the highly
redshifted 21 cm signal from Cosmic Dawn and the Epoch of Reionization by an
interferometer. The RTP system consists of analysis routines run on raw data
shortly after they are acquired, such as calibration and detection of
radio-frequency interference (RFI) events. RTP works closely with the
Librarian, the HERA data storage and transfer manager which automatically
ingests data and transfers copies to other clusters for post-processing
analysis. Both the RTP system and the Librarian are public and open source
software, which allows for them to be modified for use in other scientific
collaborations. When fully constructed, HERA is projected to generate over 50
terabytes (TB) of data each night, and the RTP system enables the successful
scientific analysis of these data.
| Search Query: ArXiv Query: search_query=au:”Jacqueline N. Hewitt”&id_list=&start=0&max_results=10