Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Transients Pipeline Overview & Status

transientskp
December 04, 2012
Science
0
91

Transients Pipeline Overview & Status

John Swinbank

transientskp

December 04, 2012
Tweet

More Decks by transientskp

See All by transientskp
Sourcefinding Strategy in MSSS, the first LOFAR survey
transientskp
0
65
A Modified Flagger for Transient Radio Signals
transientskp
0
76
Transient Detection and SQL
transientskp
0
72
The Trap: Now & Next
transientskp
0
54
Transients Database Performance
transientskp
0
56
Training the Trap
transientskp
1
54
AARTFAAC Status Update
transientskp
0
47
LOFAR + Gaia (+ X-ray) Transients
transientskp
0
81
Heterogeneous Telescope Networks
transientskp
0
59

Other Decks in Science

See All in Science
target trial emulation入門
koro485
1
3.6k
再現性の科学： 脳科学は実世界で役に立つか
ykamit
4
9.5k
Open Software for Astrophysics, AAS241
dfm
2
250
Sunday Math Party 26 - Zodiac Power 2
butchi
0
170
Introduction to Camtrap DP: A frictionless data exchange format for camera trapping data
peterdesmet
0
230
YOKONO Megumu
genomethica
0
480
Causal Inference: What If, Chapter3（前半）
norihirosuzuki
0
250
【CVPR2022論文紹介】SignGAN
mkkon
0
2.8k
論文紹介: "Webformer: Pre-training with Web Pages for Information Retrieval (SIGIR2022)"
keyakkie
2
240
Presenting Effectively with Data (in a Hurry)
thomaselove
1
150
Kaggle Days Championship予選全12回まとめ + TIPS
shimacos
0
4.3k
Models in biology, or, Biology is more theoretical than physics
yoavram
4
850

Featured

See All Featured
Java REST API Framework Comparison - PWX 2021
mraible
PRO
16
5.8k
Rebuilding a faster, lazier Slack
samanthasiow
70
7.7k
Producing Creativity
orderedlist
PRO
335
38k
Templates, Plugins, & Blocks: Oh My! Creating the theme that thinks of everything
marktimemedia
16
1.3k
The Mythical Team-Month
searls
211
41k
Ruby is Unlike a Banana
tanoku
93
9.7k
How To Stay Up To Date on Web Technology
chriscoyier
779
250k
StorybookのUI Testing Handbookを読んだ
zakiyama
9
3.5k
What's in a price? How to price your products and services
michaelherold
234
10k
Thoughts on Productivity
jonyablonski
52
2.9k
Cheating the UX When There Is Nothing More to Optimize - PixelPioneers
stephaniewalter
270
12k
Fireside Chat
paigeccino
18
2.1k

Transcript

  1. Transients Pipeline
    Overview & Status
    LOFAR TKP Project Meeting
    4 December 2012, Amsterdam
    John Swinbank
    [email protected]

    View Slide

  2. The Trap
    MonetDB Database
    Imaging
    Pipeline
    Image
    Cube
    Quality
    Control
    Lightcurve
    Storage
    Transient &
    Variability
    Analysis
    Source
    Association
    Archive
    Database
    Classification
    & Analysis
    Response
    Scheduling
    Send
    External
    Alert
    Re-run
    Image
    Analysis
    Schedule
    New
    Observation
    Other
    Facilities
    Receive
    External
    Alert
    Real-time Processing
    Off-line & External Systems
    On-line
    Processing
    Visibility
    Data
    Scheduler
    Source
    Finding

    View Slide

  3. Image Format & Metadata
    MonetDB Database
    Imaging
    Pipeline
    Image
    Cube
    Quality
    Control
    Lightcurve
    Storage
    Transient &
    Variability
    Analysis
    Source
    Association
    Archive
    Database
    Classification
    & Analysis
    Response
    Scheduling
    Send
    External
    Alert
    Re-run
    Image
    Analysis
    Schedule
    New
    Observation
    Other
    Facilities
    Receive
    External
    Alert
    Real-time Processing
    Off-line & External Systems
    On-line
    Processing
    Visibility
    Data
    Scheduler
    Source
    Finding

    View Slide

  4. Quality Control
    MonetDB Database
    Imaging
    Pipeline
    Image
    Cube
    Quality
    Control
    Lightcurve
    Storage
    Transient &
    Variability
    Analysis
    Source
    Association
    Archive
    Database
    Classification
    & Analysis
    Response
    Scheduling
    Send
    External
    Alert
    Re-run
    Image
    Analysis
    Schedule
    New
    Observation
    Other
    Facilities
    Receive
    External
    Alert
    Real-time Processing
    Off-line & External Systems
    On-line
    Processing
    Visibility
    Data
    Scheduler
    Source
    Finding
    http://www.lofar.org/operations/doku.php?id=tkp:qualitycontrol

    View Slide

  5. Sourcefinder
    MonetDB Database
    Imaging
    Pipeline
    Image
    Cube
    Quality
    Control
    Lightcurve
    Storage
    Transient &
    Variability
    Analysis
    Source
    Association
    Archive
    Database
    Classification
    & Analysis
    Response
    Scheduling
    Send
    External
    Alert
    Re-run
    Image
    Analysis
    Schedule
    New
    Observation
    Other
    Facilities
    Receive
    External
    Alert
    Real-time Processing
    Off-line & External Systems
    On-line
    Processing
    Visibility
    Data
    Scheduler
    Source
    Finding
    http://docs.transientskp.org/tkp/tools/

    View Slide

  6. Multifrequency Support
    MonetDB Database
    Imaging
    Pipeline
    Image
    Cube
    Quality
    Control
    Lightcurve
    Storage
    Transient &
    Variability
    Analysis
    Source
    Association
    Archive
    Database
    Classification
    & Analysis
    Response
    Scheduling
    Send
    External
    Alert
    Re-run
    Image
    Analysis
    Schedule
    New
    Observation
    Other
    Facilities
    Receive
    External
    Alert
    Real-time Processing
    Off-line & External Systems
    On-line
    Processing
    Visibility
    Data
    Scheduler
    Source
    Finding
    http://docs.transientskp.org/tkp/database/

    View Slide

  7. Monitoring Support
    MonetDB Database
    Imaging
    Pipeline
    Image
    Cube
    Quality
    Control
    Lightcurve
    Storage
    Transient &
    Variability
    Analysis
    Source
    Association
    Archive
    Database
    Classification
    & Analysis
    Response
    Scheduling
    Send
    External
    Alert
    Re-run
    Image
    Analysis
    Schedule
    New
    Observation
    Other
    Facilities
    Receive
    External
    Alert
    Real-time Processing
    Off-line & External Systems
    On-line
    Processing
    Visibility
    Data
    Scheduler
    Source
    Finding

    View Slide

  8. Standalone Trap
    MonetDB Database
    Imaging
    Pipeline
    Image
    Cube
    Quality
    Control
    Lightcurve
    Storage
    Transient &
    Variability
    Analysis
    Source
    Association
    Archive
    Database
    Classification
    & Analysis
    Response
    Scheduling
    Send
    External
    Alert
    Re-run
    Image
    Analysis
    Schedule
    New
    Observation
    Other
    Facilities
    Receive
    External
    Alert
    Real-time Processing
    Off-line & External Systems
    On-line
    Processing
    Visibility
    Data
    Scheduler
    Source
    Finding

    View Slide

  9. Coming Up...
    • Basic MSSS/Cycle 0 pipeline with
    little/no manual intervention:
    • Finish quality control
    • Source position systematics
    • Tidy up some source association
    issues
    • Fix bugs!
    • Developer discussion on Wednesday

    View Slide