A first look at the AARTFAAC superterp dataset

Peeyush Prasad
LOFAR Transients Key Project Meeting, Meudon, December 2011

Transcript

1. Introduction to the AARTFAAC Correlated data from the Superterp Future work and Discussion Conclusions Outline A First Look at the AARTFAAC SuperTerp Dataset Peeyush Prasad AARTFAAC-UvA December 16, 2011 LOFAR TKP Meeting, Paris TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
2. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp Future work and Discussion Conclusions Outline Outline 1 Introduction to the AARTFAAC 2 Correlated data from the Superterp 3 Future work and Discussion 4 Conclusions TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
3. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp Future work and Discussion Conclusions AARTFAAC Radio Sky Monitor (RSM) 24/7 Radio Sky Monitor, uses the 6 Superterp LOFAR stations Low resolution, low sensitivity, All-sky FoV, all the time (Piggyback) Low latency, near real-time response TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
4. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp Future work and Discussion Conclusions AARTFAAC Radio Sky Monitor (RSM) Correlate all 288 LBA dipoles within the SuperTerp, full stokes, 4MHz band, 24 KHz resolution Zenith pointing, snapshot observation mode Copied LOFAR data transferred to dedicated hardware correlator and imaging pipeline ∼ 1o resolution, 2 Jy thermal limit TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
5. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp Future work and Discussion Conclusions Calibration of the LOFAR SuperTerp Imaging with the LOFAR SuperTerp Correlated data from the SuperTerp Specs Zenith pointing, 3.2 Hrs, LBA OUTER ˜60 MHz LBA, 195 KHz x 5 subbands, 1 sec. integ, ˜3 KHz/bin, all stokes Single dipole→Station calibration table→Station Beamformer→Raw data recording Raw data recorded (˜25 TB), (Offline) LOFAR correlator, output as MS (˜5 TB) TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
6. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp Future work and Discussion Conclusions Calibration of the LOFAR SuperTerp Imaging with the LOFAR SuperTerp Correlated data from the SuperTerp Data Quality TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
7. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp Future work and Discussion Conclusions Calibration of the LOFAR SuperTerp Imaging with the LOFAR SuperTerp Correlated data from the SuperTerp Data Quality TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
8. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp Future work and Discussion Conclusions Calibration of the LOFAR SuperTerp Imaging with the LOFAR SuperTerp Correlated data from the SuperTerp Data Quality TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
9. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp Future work and Discussion Conclusions Calibration of the LOFAR SuperTerp Imaging with the LOFAR SuperTerp Calibration Single clock, with fixed offsets to different stations Wijnholds’ station calibration extended to SuperTerp BBS: Reduce Complexity? Difficult to meet latency targets Incremental calibration TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
10. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp Future work and Discussion Conclusions Calibration of the LOFAR SuperTerp Imaging with the LOFAR SuperTerp Calibration Single clock, with fixed offsets to different stations Wijnholds’ station calibration extended to SuperTerp BBS: Reduce Complexity? Difficult to meet latency targets Incremental calibration TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
11. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp Future work and Discussion Conclusions Calibration of the LOFAR SuperTerp Imaging with the LOFAR SuperTerp Calibration Single clock, with fixed offsets to different stations Wijnholds’ station calibration extended to SuperTerp BBS: Reduce Complexity? Difficult to meet latency targets Incremental calibration TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
12. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp Future work and Discussion Conclusions Calibration of the LOFAR SuperTerp Imaging with the LOFAR SuperTerp Calibration Single clock, with fixed offsets to different stations Wijnholds’ station calibration extended to SuperTerp BBS: Reduce Complexity? Difficult to meet latency targets Incremental calibration TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
13. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp Future work and Discussion Conclusions Calibration of the LOFAR SuperTerp Imaging with the LOFAR SuperTerp Station level images TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
14. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp Future work and Discussion Conclusions Calibration of the LOFAR SuperTerp Imaging with the LOFAR SuperTerp Station level images TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
15. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp Future work and Discussion Conclusions Calibration of the LOFAR SuperTerp Imaging with the LOFAR SuperTerp Station level images TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
16. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp Future work and Discussion Conclusions Calibration of the LOFAR SuperTerp Imaging with the LOFAR SuperTerp Station level images TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
17. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp Future work and Discussion Conclusions Calibration of the LOFAR SuperTerp Imaging with the LOFAR SuperTerp Station level images TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
18. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp Future work and Discussion Conclusions Calibration of the LOFAR SuperTerp Imaging with the LOFAR SuperTerp Station level images TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
19. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp Future work and Discussion Conclusions Calibration of the LOFAR SuperTerp Imaging with the LOFAR SuperTerp Station level images TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
20. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp Future work and Discussion Conclusions Calibration of the LOFAR SuperTerp Imaging with the LOFAR SuperTerp Station level images TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
21. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp Future work and Discussion Conclusions Calibration of the LOFAR SuperTerp Imaging with the LOFAR SuperTerp Station level images TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
22. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp Future work and Discussion Conclusions Calibration of the LOFAR SuperTerp Imaging with the LOFAR SuperTerp Station level images TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
23. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp Future work and Discussion Conclusions Calibration of the LOFAR SuperTerp Imaging with the LOFAR SuperTerp Station level images TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
24. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp Future work and Discussion Conclusions Calibration of the LOFAR SuperTerp Imaging with the LOFAR SuperTerp Station level images TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
25. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp Future work and Discussion Conclusions Calibration of the LOFAR SuperTerp Imaging with the LOFAR SuperTerp Station level images TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
26. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp Future work and Discussion Conclusions Calibration of the LOFAR SuperTerp Imaging with the LOFAR SuperTerp Station level images TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
27. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp Future work and Discussion Conclusions Calibration of the LOFAR SuperTerp Imaging with the LOFAR SuperTerp Station level images TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
28. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp Future work and Discussion Conclusions Calibration of the LOFAR SuperTerp Imaging with the LOFAR SuperTerp Station level images TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
29. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp Future work and Discussion Conclusions Calibration of the LOFAR SuperTerp Imaging with the LOFAR SuperTerp Station level images TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
30. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp Future work and Discussion Conclusions Calibration of the LOFAR SuperTerp Imaging with the LOFAR SuperTerp Station level images TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
31. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp Future work and Discussion Conclusions Calibration of the LOFAR SuperTerp Imaging with the LOFAR SuperTerp Imaging with the LOFAR SuperTerp TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
32. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp Future work and Discussion Conclusions Calibration of the LOFAR SuperTerp Imaging with the LOFAR SuperTerp Superterp level images TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
33. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp Future work and Discussion Conclusions Calibration of the LOFAR SuperTerp Imaging with the LOFAR SuperTerp Superterp level images TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
34. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp Future work and Discussion Conclusions Calibration of the LOFAR SuperTerp Imaging with the LOFAR SuperTerp Superterp level images TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
35. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp Future work and Discussion Conclusions Future Work Flagging: Different AOflagger strategies, performance measurement, RFI environment Other minimalistic, real-time flaggers (ARTEMIS?) Possibly a progressive calibration scheme, from one time instant to another. Pipelined imaging: Evaluate AWimager TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
36. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp Future work and Discussion Conclusions Conclusions TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
37. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp Future work and Discussion Conclusions Conclusions Dipole level correlated data available for the first time from the full SuperTerp. Data successfully interfaced to the CASA analysis package, first all-sky images coming through. Good training dataset for RFI mitigation algorithms, Imaging, Large data handling ... Very different approach to calibration and imaging required to meet latency challenges. TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
38. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp Future work and Discussion Conclusions Conclusions Dipole level correlated data available for the first time from the full SuperTerp. Data successfully interfaced to the CASA analysis package, first all-sky images coming through. Good training dataset for RFI mitigation algorithms, Imaging, Large data handling ... Very different approach to calibration and imaging required to meet latency challenges. TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
39. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp Future work and Discussion Conclusions Conclusions Dipole level correlated data available for the first time from the full SuperTerp. Data successfully interfaced to the CASA analysis package, first all-sky images coming through. Good training dataset for RFI mitigation algorithms, Imaging, Large data handling ... Very different approach to calibration and imaging required to meet latency challenges. TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
40. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp Future work and Discussion Conclusions Conclusions Dipole level correlated data available for the first time from the full SuperTerp. Data successfully interfaced to the CASA analysis package, first all-sky images coming through. Good training dataset for RFI mitigation algorithms, Imaging, Large data handling ... Very different approach to calibration and imaging required to meet latency challenges. TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC
41. institution-logo Introduction to the AARTFAAC Correlated data from the Superterp Future work and Discussion Conclusions Acknowledgements Stefan Wijnholds and Arash Owrang, ASTRON John Romein and Menno Nordem, ASTRON TKP Meeting, Meudon Peeyush Prasad, UvA/AARTFAAC