LOFAR Transients Database − The Prerequisites
◮ Raw data rate ∼ 1 TB/hr
◮ Distinct sources: ∼ 107 − 108,
⊲ 15, 000 measurements per unique source per year
⊲ A measurement is about 300 B
◮ Stored source properties reduce to 50 − 100 TB/yr
◮ Peaks over 10,000 sources per second
◮ n transients per day, n > 0
◮ Actively use database ⇒ move algorithms and statistics inside
database engine
◮ Real-time data access, quick responses ⇒ single node
◮ Accumulate data over time ⇒ multiple nodes
Bart Scheers | TKP Meeting | 2014-01-09 Transients Database Performance