Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Machine Learning and Simulations for Asset Mana...
Search
Gijs Molenaar
March 13, 2020
Science
1
91
Machine Learning and Simulations for Asset Management at Alliander
Gijs Molenaar
March 13, 2020
Tweet
Share
More Decks by Gijs Molenaar
See All by Gijs Molenaar
Easy to deploy and easy to modify data reduction pipelines using KERN and CWL
gijzelaerr
1
72
Research Engineering in Radio Astronomy
gijzelaerr
3
120
The story of CWLifying Apercal
gijzelaerr
0
94
Deep Vacuum Cleaner
gijzelaerr
1
72
EOSC LOFAR pilot final presentation
gijzelaerr
1
150
Software packaging and data pipelines
gijzelaerr
1
160
Docker - 3 years later
gijzelaerr
0
170
Radio astronomy data reduction at PyData Amsterdam
gijzelaerr
3
260
Data reduction pipelines using Docker for the MeerKAT telescope
gijzelaerr
0
110
Other Decks in Science
See All in Science
Masseyのレーティングを用いたフォーミュラレースドライバーの実績評価手法の開発 / Development of a Performance Evaluation Method for Formula Race Drivers Using Massey Ratings
konakalab
0
190
機械学習 - K近傍法 & 機械学習のお作法
trycycle
PRO
0
1.2k
データベース14: B+木 & ハッシュ索引
trycycle
PRO
0
440
02_西村訓弘_プログラムディレクター_人口減少を機にひらく未来社会.pdf
sip3ristex
0
600
地質研究者が苦労しながら運用する情報公開システムの実例
naito2000
0
260
「美は世界を救う」を心理学で実証したい~クラファンを通じた新しい研究方法
jimpe_hitsuwari
1
160
科学で迫る勝敗の法則(電気学会・SICE若手セミナー講演 2024年12月) / The principle of victory discovered by science (Lecture for young academists in IEEJ-SICE))
konakalab
0
130
CV_3_Keypoints
hachama
0
200
07_浮世満理子_アイディア高等学院学院長_一般社団法人全国心理業連合会代表理事_紹介資料.pdf
sip3ristex
0
600
ウェブ・ソーシャルメディア論文読み会 第25回: Differences in misinformation sharing can lead to politically asymmetric sanctions (Nature, 2024)
hkefka385
0
130
学術講演会中央大学学員会府中支部
tagtag
0
300
CV_5_3dVision
hachama
0
150
Featured
See All Featured
Learning to Love Humans: Emotional Interface Design
aarron
273
40k
Building Better People: How to give real-time feedback that sticks.
wjessup
368
19k
Typedesign – Prime Four
hannesfritz
42
2.8k
Visualization
eitanlees
148
16k
How GitHub (no longer) Works
holman
315
140k
Bash Introduction
62gerente
615
210k
The Illustrated Children's Guide to Kubernetes
chrisshort
48
50k
Performance Is Good for Brains [We Love Speed 2024]
tammyeverts
12
1.1k
Music & Morning Musume
bryan
46
6.8k
Scaling GitHub
holman
463
140k
Design and Strategy: How to Deal with People Who Don’t "Get" Design
morganepeng
131
19k
Six Lessons from altMBA
skipperchong
28
4k
Transcript
Machine Learning and Simulations for Asset Management March 13, 2020,
NL-RSE Meetup Gijs Molenaar
pythonic.nl • Me! • Freelance Software/Research Engineer • MSc AI
(UvA) • PhD astronomy (South Africa)
• Public Utility company • 5.7 million client connections •
5700 FTE
None
None
The problem • Fixed budget • How to optimally distribute
budget over departments • Balance between long term and short term goals
Amsterdam • Go fully electric by 2030 • 900.000 people
• 230.000 private cars • 10 years • 2610 working days • 1000 charging stations a day?
Our solution • Build agent based simulation of company •
Run millions of simulations up to 40 years in the future • Let Reinforcement Learning agent explore and optimize problem space
What do we need? • A physical model • A
bunch of agents manipulating this model
None
None
Reinforcement Learning
Reinforcement Learning st st+1 a
Deep-Q learning Simulation agent != Reinforcent learning Agent
State • Number of connection issues Reward • function of
• Budget spend • Average waiting time for new connection • Average Waiting time for fix of broken connection Action Decision of budget split
Project structure • 3 teams: • Data Engineers • Data
Scientists • Software Engineers
None
Evaluating 2 strategies • Compute in neo4j • Compute in
NumPy + NetworkIt
None
Rpy2 R has NA values in int arrays, numpy has
NaN in float arrays
Status report • Still working on simulations • Underestimated the
effort required to get this right • Maybe too ambitious? • Useful nonetheless
Research Engineer in Corporate environment • Different setting • Requires
different mindset • More budget • A lot of politics
pythonic.nl available again! • 1 June 2020 • First getting
married in Namibia • If we don’t get Corona banned
Questions?