Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Machine Learning and Simulations for Asset Mana...
Search
Gijs Molenaar
March 13, 2020
Science
1
91
Machine Learning and Simulations for Asset Management at Alliander
Gijs Molenaar
March 13, 2020
Tweet
Share
More Decks by Gijs Molenaar
See All by Gijs Molenaar
Easy to deploy and easy to modify data reduction pipelines using KERN and CWL
gijzelaerr
1
73
Research Engineering in Radio Astronomy
gijzelaerr
3
120
The story of CWLifying Apercal
gijzelaerr
0
95
Deep Vacuum Cleaner
gijzelaerr
1
72
EOSC LOFAR pilot final presentation
gijzelaerr
1
150
Software packaging and data pipelines
gijzelaerr
1
160
Docker - 3 years later
gijzelaerr
0
170
Radio astronomy data reduction at PyData Amsterdam
gijzelaerr
3
260
Data reduction pipelines using Docker for the MeerKAT telescope
gijzelaerr
0
110
Other Decks in Science
See All in Science
統計的因果探索: 背景知識とデータにより因果仮説を探索する
sshimizu2006
4
1k
07_浮世満理子_アイディア高等学院学院長_一般社団法人全国心理業連合会代表理事_紹介資料.pdf
sip3ristex
0
610
オンプレミス環境にKubernetesを構築する
koukimiura
0
350
機械学習 - SVM
trycycle
PRO
1
880
研究って何だっけ / What is Research?
ks91
PRO
1
120
高校生就活へのDA導入の提案
shunyanoda
0
5.9k
Symfony Console Facelift
chalasr
2
470
データベース04: SQL (1/3) 単純質問 & 集約演算
trycycle
PRO
0
990
システム数理と応用分野の未来を切り拓くロードマップ・エンターテインメント(スポーツ)への応用 / Applied mathematics for sports entertainment
konakalab
1
390
データマイニング - コミュニティ発見
trycycle
PRO
0
150
点群ライブラリPDALをGoogleColabにて実行する方法の紹介
kentaitakura
1
400
傾向スコアによる効果検証 / Propensity Score Analysis and Causal Effect Estimation
ikuma_w
0
130
Featured
See All Featured
The Illustrated Children's Guide to Kubernetes
chrisshort
48
50k
The Invisible Side of Design
smashingmag
301
51k
Practical Orchestrator
shlominoach
190
11k
YesSQL, Process and Tooling at Scale
rocio
173
14k
Understanding Cognitive Biases in Performance Measurement
bluesmoon
29
1.9k
Improving Core Web Vitals using Speculation Rules API
sergeychernyshev
18
1.1k
Rails Girls Zürich Keynote
gr2m
95
14k
Embracing the Ebb and Flow
colly
87
4.8k
How GitHub (no longer) Works
holman
315
140k
個人開発の失敗を避けるイケてる考え方 / tips for indie hackers
panda_program
113
20k
Chrome DevTools: State of the Union 2024 - Debugging React & Beyond
addyosmani
7
850
The Pragmatic Product Professional
lauravandoore
36
6.9k
Transcript
Machine Learning and Simulations for Asset Management March 13, 2020,
NL-RSE Meetup Gijs Molenaar
pythonic.nl • Me! • Freelance Software/Research Engineer • MSc AI
(UvA) • PhD astronomy (South Africa)
• Public Utility company • 5.7 million client connections •
5700 FTE
None
None
The problem • Fixed budget • How to optimally distribute
budget over departments • Balance between long term and short term goals
Amsterdam • Go fully electric by 2030 • 900.000 people
• 230.000 private cars • 10 years • 2610 working days • 1000 charging stations a day?
Our solution • Build agent based simulation of company •
Run millions of simulations up to 40 years in the future • Let Reinforcement Learning agent explore and optimize problem space
What do we need? • A physical model • A
bunch of agents manipulating this model
None
None
Reinforcement Learning
Reinforcement Learning st st+1 a
Deep-Q learning Simulation agent != Reinforcent learning Agent
State • Number of connection issues Reward • function of
• Budget spend • Average waiting time for new connection • Average Waiting time for fix of broken connection Action Decision of budget split
Project structure • 3 teams: • Data Engineers • Data
Scientists • Software Engineers
None
Evaluating 2 strategies • Compute in neo4j • Compute in
NumPy + NetworkIt
None
Rpy2 R has NA values in int arrays, numpy has
NaN in float arrays
Status report • Still working on simulations • Underestimated the
effort required to get this right • Maybe too ambitious? • Useful nonetheless
Research Engineer in Corporate environment • Different setting • Requires
different mindset • More budget • A lot of politics
pythonic.nl available again! • 1 June 2020 • First getting
married in Namibia • If we don’t get Corona banned
Questions?