Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Open software for Astronomical Data Analysis
Search
Dan Foreman-Mackey
February 28, 2023
Science
0
97
Open software for Astronomical Data Analysis
@ NASA Goddard
Dan Foreman-Mackey
February 28, 2023
Tweet
Share
More Decks by Dan Foreman-Mackey
See All by Dan Foreman-Mackey
Open Software for Astrophysics, AAS241
dfm
2
430
My research talk for CCA promotion
dfm
1
730
Astronomical software
dfm
1
670
emcee-odi
dfm
1
560
Exoplanet population inference: a tutorial
dfm
3
410
Data-driven discovery in the astronomical time domain
dfm
6
660
TensorFlow for astronomers
dfm
6
670
How to find a transiting exoplanets
dfm
1
390
Long-period transiting exoplanets
dfm
1
290
Other Decks in Science
See All in Science
AI科学の何が“哲学”の問題になるのか ~問いマッピングの試み~
rmaruy
1
1.6k
AI Alignment: A Comprehensive Survey
s_ota
0
200
[NeurIPS 2023 論文読み会] Wasserstein Quantum Monte Carlo
stakaya
0
370
ベイズ最適化をゼロから
brainpadpr
2
220
ウェーブレットおきもち講座
aikiriao
1
730
Machine Learning for Materials (Lecture 3)
aronwalsh
0
870
深層学習を利用して 大豆の外部欠陥を判別した研究事例の紹介
kentaitakura
0
120
Machine Learning for Materials (Lecture 1)
aronwalsh
1
1.6k
統計的因果探索の方法
sshimizu2006
1
940
KDD2023学会参加報告
tereka114
2
370
Machine Learning for Materials (Lecture 6)
aronwalsh
0
440
Spark_Task_Optimization_Journey_How_I_Increased_10x_Speed_by_Performance_Tuning
tlyu0419
0
210
Featured
See All Featured
BBQ
matthewcrist
80
8.8k
Gamification - CAS2011
davidbonilla
77
4.7k
Principles of Awesome APIs and How to Build Them.
keavy
122
16k
Exploring the Power of Turbo Streams & Action Cable | RailsConf2023
kevinliebholz
10
3.6k
Clear Off the Table
cherdarchuk
87
310k
Infographics Made Easy
chrislema
238
18k
Side Projects
sachag
451
41k
A Philosophy of Restraint
colly
198
16k
A better future with KSS
kneath
231
17k
Reflections from 52 weeks, 52 projects
jeffersonlam
345
19k
Building an army of robots
kneath
300
42k
Documentation Writing (for coders)
carmenintech
61
4.1k
Transcript
OPEN SOFTWARE FOR ASTRONOMICAL DATA ANALYSIS by Dan Foreman-Mackey
None
open software for astrophysics 0
credit: Adrian Price-Whelan / / data: SAO/NASA ADS
7
many fundamental software packages have a shockingly small number of
maintainers.
7 credit: Adrian Price-Whelan
* astronomical software can be very high impact * we
should think about career trajectories & mechanisms for supporting this work
None
case study: gaussian processes 1
°0.6 °0.3 0.0 0.3 0.6 raw [ppt] 0 5 10
15 20 25 time [days] °0.30 °0.15 0.00 de-trended [ppt] N = 1000 reference: DFM+ (2017)
°0.6 °0.3 0.0 0.3 0.6 raw [ppt] 0 5 10
15 20 25 time [days] °0.30 °0.15 0.00 de-trended [ppt] N = 1000 reference: DFM+ (2017)
reference: Aigrain & DFM (2022)
reference: Aigrain & DFM (2022)
reference: Aigrain & DFM (2022) ignoring correlated noise accounting for
correlated noise
reference: Aigrain & DFM (2022)
a Gaussian Process is a drop - in replacement for
chi - squared
more details: Aigrain & Foreman-Mackey (2023) arXiv:2209.08940
None
7 [1] model building [2] computational cost
reference: Luger, DFM, Hedges (2021)
[2] computational cost
7 [1] bigger/better computers [2] exploit matrix structure [3] approximate
linear algebra [4] etc.
1 3 2
None
None
1 3 2
°0.6 °0.3 0.0 0.3 0.6 raw [ppt] 0 5 10
15 20 25 time [days] °0.30 °0.15 0.00 de-trended [ppt] N = 1000 reference: DFM+ (2017)
reference: Gordon, Agol, DFM (2020) / tinygp.readthedocs.io
* a Gaussian Process is a drop - in replacement
for chi squared * model building & computational cost are (solvable!) challenges * you should check out tinygp!
case study: probabilistic inference 2
have: physics = > data
want: data = > physics
7 [1] physical models [2] legacy code
None
number of parameters patience required a few tenish not outrageously
many reference: DFM (priv. comm.)
number of parameters patience required emcee a few tenish not
outrageously many reference: DFM (priv. comm.)
number of parameters patience required emcee a few tenish not
outrageously many how things should be reference: DFM (priv. comm.)
None
None
None
None
3.0 3.5 4.0 4.5 5.0 Wavelength [micron] 2.05 2.10 2.15
2.20 2.25 2.30 Transit Depth [%] Alderson et al. 2023 Joint Fit (N = 50) reference: Soichiro Hattori, Ruth Angus, DFM, . . . (in prep) WASP-39b / NIRSpec
reference: Soichiro Hattori, Ruth Angus, DFM, . . . (in
prep) showing 23 of the 404 parameters (8 per channel + 4 shared)
how?
d(physics = > data) / dphysics
automatic differentiation aka “backpropagation”
None
7 [1] physical models [2] legacy code
7 [1] domain - specif i c libraries [2] emulation
None
* gradient - based inference using autodiff can improve eff
i ciency * there are practical challenges with these methods in astro * of interest: domain - specif i c libraries & emulation
aside: JAX 3
None
import numpy as np def linear_least_squares(x, y) : A =
np.vander(x, 2) return np.linalg.lstsq(A, y)[0]
import jax.numpy as jnp def linear_least_squares(x, y) : A =
jnp.vander(x, 2) return jnp.linalg.lstsq(A, y)[0]
None
open research practices 4
None
None
None
None
None
None
None
open software is foundational to astrophysics research there are opportunities
at the interface of astro & applied f i elds there are ways you can participate & benef i t right away
7 I want to chat about… [1] your data analysis
problems [2] building astronomical software [3] writing documentation & tutorials
get in touch! dfm.io github.com/dfm