=====Data Processing=====

On December 07, 2020 Jon had an email discussion with Wael Farah. Wael is a SETI Institute employee and is developing the new SNAP board based correlator. He gave me some insights into the data we can expect from the ATA. 

===File Format===

The data will be in the Breakthrough Listen Raw Data Format. See https://github.com/UCBerkeleySETI/breakthrough/blob/master/doc/RAW-File-Format.md for an explanation.

The details are sketchy to me, even with Wael's explanation. So I need to investigate with some real data. He states:

  For a single antenna, parsing the full 4096 channels, and assuming 
  4bits real + 4bits imaginary, the maximum throughput for a single 
  snap board is 2 GBytes/s
  
Wael also suggested this file, it is just random static, but I can use it to get used to the format. https://storage.googleapis.com/ata_test_data/Luigi_turboSETI/guppi_59187_24580_120775_Unknown_0001.rawspec.0000.h5 : Careful, it is 3.8GB

Look at https://github.com/UCBerkeleySETI/blimpy and like for GuppiRaw. I think this is how you erad in the files.

===Data===

I'm trying to decipher the docs and figure out exactly what data we are presented with...

===References===

  * Really good explanation of the observing and data at the Greenbank Telescope: https://github.com/UCBerkeleySETI/breakthrough/tree/master/GBT

For now (Dec 08, 2020) the online breakthrough data is offline. Have to wait to get some. - JR