Upgrade to Pro — share decks privately, control downloads, hide ads and more …

A first look at the AARTFAAC superterp dataset

A first look at the AARTFAAC superterp dataset

Peeyush Prasad
LOFAR Transients Key Project Meeting, Meudon, December 2011

Ab44292d7d6f032baf342a98230a6654?s=128

transientskp

June 23, 2012
Tweet

Transcript

  1. Introduction to the AARTFAAC Correlated data from the Superterp Future

    work and Discussion Conclusions Outline A First Look at the AARTFAAC SuperTerp Dataset Peeyush Prasad AARTFAAC-UvA December 16, 2011 LOFAR TKP Meeting, Paris TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
  2. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp

    Future work and Discussion Conclusions Outline Outline 1 Introduction to the AARTFAAC 2 Correlated data from the Superterp 3 Future work and Discussion 4 Conclusions TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
  3. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp

    Future work and Discussion Conclusions AARTFAAC Radio Sky Monitor (RSM) 24/7 Radio Sky Monitor, uses the 6 Superterp LOFAR stations Low resolution, low sensitivity, All-sky FoV, all the time (Piggyback) Low latency, near real-time response TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
  4. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp

    Future work and Discussion Conclusions AARTFAAC Radio Sky Monitor (RSM) Correlate all 288 LBA dipoles within the SuperTerp, full stokes, 4MHz band, 24 KHz resolution Zenith pointing, snapshot observation mode Copied LOFAR data transferred to dedicated hardware correlator and imaging pipeline ∼ 1o resolution, 2 Jy thermal limit TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
  5. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp

    Future work and Discussion Conclusions Calibration of the LOFAR SuperTerp Imaging with the LOFAR SuperTerp Correlated data from the SuperTerp Specs Zenith pointing, 3.2 Hrs, LBA OUTER ˜60 MHz LBA, 195 KHz x 5 subbands, 1 sec. integ, ˜3 KHz/bin, all stokes Single dipole→Station calibration table→Station Beamformer→Raw data recording Raw data recorded (˜25 TB), (Offline) LOFAR correlator, output as MS (˜5 TB) TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
  6. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp

    Future work and Discussion Conclusions Calibration of the LOFAR SuperTerp Imaging with the LOFAR SuperTerp Correlated data from the SuperTerp Data Quality TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
  7. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp

    Future work and Discussion Conclusions Calibration of the LOFAR SuperTerp Imaging with the LOFAR SuperTerp Correlated data from the SuperTerp Data Quality TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
  8. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp

    Future work and Discussion Conclusions Calibration of the LOFAR SuperTerp Imaging with the LOFAR SuperTerp Correlated data from the SuperTerp Data Quality TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
  9. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp

    Future work and Discussion Conclusions Calibration of the LOFAR SuperTerp Imaging with the LOFAR SuperTerp Calibration Single clock, with fixed offsets to different stations Wijnholds’ station calibration extended to SuperTerp BBS: Reduce Complexity? Difficult to meet latency targets Incremental calibration TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
  10. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp

    Future work and Discussion Conclusions Calibration of the LOFAR SuperTerp Imaging with the LOFAR SuperTerp Calibration Single clock, with fixed offsets to different stations Wijnholds’ station calibration extended to SuperTerp BBS: Reduce Complexity? Difficult to meet latency targets Incremental calibration TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
  11. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp

    Future work and Discussion Conclusions Calibration of the LOFAR SuperTerp Imaging with the LOFAR SuperTerp Calibration Single clock, with fixed offsets to different stations Wijnholds’ station calibration extended to SuperTerp BBS: Reduce Complexity? Difficult to meet latency targets Incremental calibration TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
  12. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp

    Future work and Discussion Conclusions Calibration of the LOFAR SuperTerp Imaging with the LOFAR SuperTerp Calibration Single clock, with fixed offsets to different stations Wijnholds’ station calibration extended to SuperTerp BBS: Reduce Complexity? Difficult to meet latency targets Incremental calibration TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
  13. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp

    Future work and Discussion Conclusions Calibration of the LOFAR SuperTerp Imaging with the LOFAR SuperTerp Station level images TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
  14. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp

    Future work and Discussion Conclusions Calibration of the LOFAR SuperTerp Imaging with the LOFAR SuperTerp Station level images TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
  15. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp

    Future work and Discussion Conclusions Calibration of the LOFAR SuperTerp Imaging with the LOFAR SuperTerp Station level images TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
  16. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp

    Future work and Discussion Conclusions Calibration of the LOFAR SuperTerp Imaging with the LOFAR SuperTerp Station level images TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
  17. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp

    Future work and Discussion Conclusions Calibration of the LOFAR SuperTerp Imaging with the LOFAR SuperTerp Station level images TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
  18. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp

    Future work and Discussion Conclusions Calibration of the LOFAR SuperTerp Imaging with the LOFAR SuperTerp Station level images TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
  19. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp

    Future work and Discussion Conclusions Calibration of the LOFAR SuperTerp Imaging with the LOFAR SuperTerp Station level images TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
  20. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp

    Future work and Discussion Conclusions Calibration of the LOFAR SuperTerp Imaging with the LOFAR SuperTerp Station level images TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
  21. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp

    Future work and Discussion Conclusions Calibration of the LOFAR SuperTerp Imaging with the LOFAR SuperTerp Station level images TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
  22. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp

    Future work and Discussion Conclusions Calibration of the LOFAR SuperTerp Imaging with the LOFAR SuperTerp Station level images TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
  23. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp

    Future work and Discussion Conclusions Calibration of the LOFAR SuperTerp Imaging with the LOFAR SuperTerp Station level images TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
  24. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp

    Future work and Discussion Conclusions Calibration of the LOFAR SuperTerp Imaging with the LOFAR SuperTerp Station level images TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
  25. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp

    Future work and Discussion Conclusions Calibration of the LOFAR SuperTerp Imaging with the LOFAR SuperTerp Station level images TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
  26. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp

    Future work and Discussion Conclusions Calibration of the LOFAR SuperTerp Imaging with the LOFAR SuperTerp Station level images TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
  27. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp

    Future work and Discussion Conclusions Calibration of the LOFAR SuperTerp Imaging with the LOFAR SuperTerp Station level images TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
  28. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp

    Future work and Discussion Conclusions Calibration of the LOFAR SuperTerp Imaging with the LOFAR SuperTerp Station level images TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
  29. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp

    Future work and Discussion Conclusions Calibration of the LOFAR SuperTerp Imaging with the LOFAR SuperTerp Station level images TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
  30. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp

    Future work and Discussion Conclusions Calibration of the LOFAR SuperTerp Imaging with the LOFAR SuperTerp Station level images TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
  31. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp

    Future work and Discussion Conclusions Calibration of the LOFAR SuperTerp Imaging with the LOFAR SuperTerp Imaging with the LOFAR SuperTerp TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
  32. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp

    Future work and Discussion Conclusions Calibration of the LOFAR SuperTerp Imaging with the LOFAR SuperTerp Superterp level images TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
  33. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp

    Future work and Discussion Conclusions Calibration of the LOFAR SuperTerp Imaging with the LOFAR SuperTerp Superterp level images TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
  34. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp

    Future work and Discussion Conclusions Calibration of the LOFAR SuperTerp Imaging with the LOFAR SuperTerp Superterp level images TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
  35. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp

    Future work and Discussion Conclusions Future Work Flagging: Different AOflagger strategies, performance measurement, RFI environment Other minimalistic, real-time flaggers (ARTEMIS?) Possibly a progressive calibration scheme, from one time instant to another. Pipelined imaging: Evaluate AWimager TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
  36. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp

    Future work and Discussion Conclusions Conclusions TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
  37. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp

    Future work and Discussion Conclusions Conclusions Dipole level correlated data available for the first time from the full SuperTerp. Data successfully interfaced to the CASA analysis package, first all-sky images coming through. Good training dataset for RFI mitigation algorithms, Imaging, Large data handling ... Very different approach to calibration and imaging required to meet latency challenges. TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
  38. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp

    Future work and Discussion Conclusions Conclusions Dipole level correlated data available for the first time from the full SuperTerp. Data successfully interfaced to the CASA analysis package, first all-sky images coming through. Good training dataset for RFI mitigation algorithms, Imaging, Large data handling ... Very different approach to calibration and imaging required to meet latency challenges. TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
  39. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp

    Future work and Discussion Conclusions Conclusions Dipole level correlated data available for the first time from the full SuperTerp. Data successfully interfaced to the CASA analysis package, first all-sky images coming through. Good training dataset for RFI mitigation algorithms, Imaging, Large data handling ... Very different approach to calibration and imaging required to meet latency challenges. TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
  40. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp

    Future work and Discussion Conclusions Conclusions Dipole level correlated data available for the first time from the full SuperTerp. Data successfully interfaced to the CASA analysis package, first all-sky images coming through. Good training dataset for RFI mitigation algorithms, Imaging, Large data handling ... Very different approach to calibration and imaging required to meet latency challenges. TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
  41. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp

    Future work and Discussion Conclusions Acknowledgements Stefan Wijnholds and Arash Owrang, ASTRON John Romein and Menno Nordem, ASTRON TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC