A 3-minute rant on the "deluge of data" in astronomy

Slide 1

Slide 1 text

A 3-minute rant on the "deluge of data" in astronomy by Geert Barentsen (@GeertHub) 1

Slide 2

Slide 2 text

11011010 10111011 01000110 01000011 00010011 10011001 00101100 00101111 10101110 10010000 11110110 01100100 10001011 01000111 10111111 11110000 01001110 10000110 01011111 01111110 11001000 10100000 10110111 11110111 11001000 11100100 00001110 01000100 00010001 01000111 00101011 01100101 10010110 01001100 11100110 01011101

Slide 3

Slide 3 text

Pixel rates of our largest optical surveys double every 41 months 3

Slide 4

Slide 4 text

CCD-based astronomy is limited by glass and atmosphere; it does not track Moore’s law! 4

Slide 5

Slide 5 text

CPU transistor counts double every 23 months 5

Slide 6

Slide 6 text

Supercomputer FLOPS double every 13 months 6

Slide 7

Slide 7 text

Internet speeds double every 16 months 7

Slide 8

Slide 8 text

Disk drive storage doubles every 23 months 8

Slide 9

Slide 9 text

Storage bus speeds double every 35 months 9

Slide 10

Slide 10 text

2000 (SDSS) vs 2022 (LSST), if trends continue: • 81x more pixels; • 190x faster I/O; • 2565x more storage; • 120 578x faster internet; • 1 202 277x faster supercomputers. 10

Slide 11

Slide 11 text

The increase in CCD data is vastly outstripped by the deluge of computing power. (Not true for radio astronomy.) 11

Slide 12

Slide 12 text

Let’s ride the tsunami of computing power! Graphs and data points are here: http://github.com/barentsen/tech-progress-data 12