Differences

This shows you the differences between two versions of the page.

--- data_processing [2020/12/08 16:42] – created jrseti
+++ data_processing [2020/12/11 23:56] (current) – jrseti
@@ Line 1: / Line 1: @@
 =====Data Processing=====
-===xx===
+On December 07, 2020 Jon had an email discussion with Wael Farah. Wael is a SETI Institute employee and is developing the new SNAP board based correlator. He gave me some insights into the data we can expect from the ATA.
+===File Format===
+The data will be in the Breakthrough Listen Raw Data Format. See https://github.com/UCBerkeleySETI/breakthrough/blob/master/doc/RAW-File-Format.md for an explanation.
+The details are sketchy to me, even with Wael's explanation. So I need to investigate with some real data. He states:
+  For a single antenna, parsing the full 4096 channels, and assuming
+bits real + 4bits imaginary, the maximum throughput for a single
+  snap board is 2 GBytes/s
+Wael also suggested this file, it is just random static, but I can use it to get used to the format. https://storage.googleapis.com/ata_test_data/Luigi_turboSETI/guppi_59187_24580_120775_Unknown_0001.rawspec.0000.h5 : Careful, it is 3.8GB
+Look at https://github.com/UCBerkeleySETI/blimpy and like for GuppiRaw. I think this is how you erad in the files.
+===Data===
+I'm trying to decipher the docs and figure out exactly what data we are presented with...
+===References===
+  * Really good explanation of the observing and data at the Greenbank Telescope: https://github.com/UCBerkeleySETI/breakthrough/tree/master/GBT
+For now (Dec 08, 2020) the online breakthrough data is offline. Have to wait to get some. - JR