Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
TBD + update on FRATs WG activities
Search
transientskp
June 23, 2012
Science
0
93
TBD + update on FRATs WG activities
Sander ter Veen
LOFAR Transients Key Project Meeting, Meudon, December 2011
transientskp
June 23, 2012
Tweet
Share
More Decks by transientskp
See All by transientskp
Sourcefinding Strategy in MSSS, the first LOFAR survey
transientskp
0
93
A Modified Flagger for Transient Radio Signals
transientskp
0
120
Transient Detection and SQL
transientskp
0
170
The Trap: Now & Next
transientskp
0
88
Transients Database Performance
transientskp
0
130
Training the Trap
transientskp
1
96
AARTFAAC Status Update
transientskp
0
99
LOFAR + Gaia (+ X-ray) Transients
transientskp
0
150
Heterogeneous Telescope Networks
transientskp
0
110
Other Decks in Science
See All in Science
小杉考司(専修大学)
kosugitti
2
610
20分で分かる Human-in-the-Loop 機械学習におけるアノテーションとヒューマンコンピューターインタラクションの真髄
hurutoriya
5
2.8k
04_石井クンツ昌子_お茶の水女子大学理事_副学長_D_I社会実現へ向けて.pdf
sip3ristex
0
130
学術講演会中央大学学員会いわき支部
tagtag
0
130
学術講演会中央大学学員会八王子支部
tagtag
0
270
インフラだけではない MLOps の話 @事例でわかるMLOps 機械学習の成果をスケールさせる処方箋 発売記念
icoxfog417
PRO
2
710
Causal discovery based on non-Gaussianity and nonlinearity
sshimizu2006
0
230
事業会社における 機械学習・推薦システム技術の活用事例と必要な能力 / ml-recsys-in-layerx-wantedly-2024
yuya4
4
290
Tensor Representations in Signal Processing and Machine Learning (Tutorial at APSIPA-ASC 2020)
yokotatsuya
0
110
How were Quaternion discovered
kinakomoti321
2
1.2k
非同期コミュニケーションの構造 -チャットツールを用いた組織における情報の流れの設計について-
koisono
0
210
The Incredible Machine: Developer Productivity and the Impact of AI
tomzimmermann
0
530
Featured
See All Featured
We Have a Design System, Now What?
morganepeng
51
7.4k
Documentation Writing (for coders)
carmenintech
67
4.6k
What's in a price? How to price your products and services
michaelherold
244
12k
Keith and Marios Guide to Fast Websites
keithpitt
411
22k
Why Our Code Smells
bkeepers
PRO
336
57k
Navigating Team Friction
lara
183
15k
Principles of Awesome APIs and How to Build Them.
keavy
126
17k
A Philosophy of Restraint
colly
203
16k
Fashionably flexible responsive web design (full day workshop)
malarkey
406
66k
The Web Performance Landscape in 2024 [PerfNow 2024]
tammyeverts
4
410
Put a Button on it: Removing Barriers to Going Fast.
kastner
60
3.7k
Exploring the Power of Turbo Streams & Action Cable | RailsConf2023
kevinliebholz
30
4.6k
Transcript
Progress on the TBB front: FRATS and Cosmic Rays Sander ter Veen For the FRATS working group and the Cosmic Ray KSP
Transient Buffer Board (TBB) Store the raw data of each dipole/1le signal in a RAM ring buffer
Taking TBB data Step 1: Step 2: Select dipoles/staEons Select 5 μs – >1.3s of data
Turn the LOFAR telescope ….
into the Virtual LOFAR telescope
High Eme resoluEon (5ns) Large bandwidth (100 MHz) Lightning flash recorded with TBBs
All/large sky coverage Lightning direc1on finding LBA all‐sky image with 1 sta1on
Near‐field imaging Cosmic Rays Pulsed RFI
Parallel system Imaging + Beamformed And TBB Cosmic Rays! Credit: George Heald and LOFAR Pulsar Working Group
Limited Eme • 1.3 s at full resoluEon • More Eme by: – Less bandwidth – 25s @ 5 MHz – Less elements – More memory (upgrade to 5.2 s?)
– 100s @ 5 MHz
Obtaining TBB data • Current framework: Python scripts – Trigger handling program listens for triggers (UDP packages) – If a trigger is received check if dumping is allowed: • Is there an observaEon running? • Does the current project allow dumping?
• Does the current observaEon allow dumping? • Is dumping allowed on all observaEons at this Eme? – Is the current observaEon excluded? • Wanted: key that tells if dumping is allowed – Execute ssh commands at the staEon to tell them to dump data
Official TBB Trigger handling framework • Triggerbox (astronomer program) sends requests (STOP, DUMP, RESTART) • Requests are handled by central system (MAC) • Central system checks if requests can be complied to
• Central system asks the staEons to send TBB data. • Coming soon…
TBB data writer • A new data writer is started on each storage node at every new observaEon • Part of the metadata is added to the previous observaEon by a separate program • ASTRON is working on a new official supported data writer including metadata
• Similar to beam‐formed HDF5 data writer. • New data writer should support subband data
Science cases • Fast Radio Transients (FRATs) • Very High Energy Cosmic Rays (VHECR) • Ultra High Energy Cosmic Rays (NuMoon)
Possible FRATs Sources Millisecond pulses from: Pulsars/ RRATs (exo) planets Flare stars
Other sparkers? Lorimer et al. 2007 Keane et al. 2011
DetecEon • Rare events – Cover large area: • Incoherent beam – Cover long duraEon: • Parallel observaEons • Dispersed events: – MulEple DM trials
• Source idenEficaEon: – Use Transient Buffer Boards
FRATS ObservaEon Diagram Transient Buffer Board Data storage LOFAR dipoles Trigger algorithm Dump request handler
“Transient detected” ObservaEon parameters BlueGene/P UV Data BF Data BF Data TBB Data
FRATS Real‐Eme detecEon. Dedispersion in mulEple frequency bands Coincidence requirement between the bands Image from TBB data Used to idenEfy source
MSSS + FRATS • Piggy‐back on MSSS observaEons • Add incoherent stokes to MSSS observaEon • Send incoherent stokes to separate node • Test observaEons showed no severe data loss on imaging data
• Test run last weekend (9‐11 december) – No imaging dataloss in all but 1 (Cal.) observaEon • Incoherent stokes can be added
Current Trigger algorithm issues • In progress: Allow for non‐conEnuous frequency axis (MSSS) • To Do: Smarter RFI checks – MulE‐beam anE‐coincidence – DM=0 veto with last N samples – Pelican rouEnes? •
To Do: Check if pulse is likely from a known pulsar (k3match)
To Do: TBB data reducEon • TBB data volume is very large ~ 2 TB • Data volume can be reduced in two ways: • “staEon beamforming” – Some dipoles to form a staEon beams – Factor 48 reducEon – But: Lose sensiEvity outside primary beam (RFI in sidelobes)
• Coherent dedispersion – Only keep a fracEon of the Emeseries – Factor 10‐100 – But: Unable to analyse for other DMs
Cosmic Rays Very High Energy Cosmic Rays
Why study Cosmic Rays? • Most energeEc parEcles • Origin: AGN ? • To determine – Chemical composiEon – DirecEon – Energy
• Radio emission – complementary probe – 100% duty cycle
Radia1on mechanisms • Two main coherent emission mechanisms: • Charge excess (Askaryan, NuMoon in air) • GeomagneEc effect
Why CR + LOFAR • Dense instrumentaEon (polarizaEon!) • Probe electromagneEc field at many points • Pin down emission processes • Derive the properEes of air showers through radio emission
• Measure spectrum and composiEon of CR from 1017 ‐1019 eV (transiEon GalacEc to extragalacEc origin)
Cosmic Ray Detec1on • Two methods: – Radio self‐trigger • Any LOFAR staEon (large area) • But also RFI triggers – LORA triggered • No false triggers • Small area (only CRs near Superterp) • Train radio‐only trigger
• Obtain 1‐5 ms of Transient Buffer Board data
Royal Fes1ve Intermezzo (RFI)
Effec1ve RFI excision
There is another way: • LOFAR Radboud air shower Array (LORA) • ScinEllator array on superterp detects electrons and muons. • Coincidence between the scinEllators are cosmic rays
• Trigger TBBs from LORA
ObservaEon Diagram Transient Buffer Board Data storage LOFAR dipoles Dump request handler ObservaEon parameters
BlueGene/P UV Data BF Data TBB Data LORA ParEcle detector “Cosmic Ray Detected”
Cosmic Ray Foot(finger) Print
The Virtual LOFAR telescope: TBB data + pycrtools (LUS)
Analysis pipeline
Calibra1on
Peak IdenEficaEon
Find delays between dipoles
DirecEon esEmaEon
Delay stability
Beamforming
Lateral DistribuEon FuncEon
Theory matches signal?
Where is the shower core?
Where is the shower core? LDF, LORA esEmated core
Where is the shower core? LDF, Core by LOFAR Barycenter
Where is the shower core? LDF, LOFAR ConEnuity requirement
NuMoon • CR and neutrino > 10^21 eV • Large surface: Moon • Nanosecond pulses • Skip 2nd PPF Works •
Invert staEon PPF • Correct for misalignment from clocks • Noise analysis on 5 min data chunks
Conclusion • TBBs are a very usefull addiEon to the system • First tests FRATs + MSSS succesful • LOFAR is a major facility for radio detecEon of cosmic rays • Cosmic Ray observaEons and analysis (almost)
automated – SEll manually set permissions – Manually start trigger system and datawriters on CEP once.