Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Machine Learning and Simulations for Asset Mana...
Search
Gijs Molenaar
March 13, 2020
Science
1
89
Machine Learning and Simulations for Asset Management at Alliander
Gijs Molenaar
March 13, 2020
Tweet
Share
More Decks by Gijs Molenaar
See All by Gijs Molenaar
Easy to deploy and easy to modify data reduction pipelines using KERN and CWL
gijzelaerr
1
69
Research Engineering in Radio Astronomy
gijzelaerr
3
110
The story of CWLifying Apercal
gijzelaerr
0
89
Deep Vacuum Cleaner
gijzelaerr
1
68
EOSC LOFAR pilot final presentation
gijzelaerr
1
150
Software packaging and data pipelines
gijzelaerr
1
160
Docker - 3 years later
gijzelaerr
0
170
Radio astronomy data reduction at PyData Amsterdam
gijzelaerr
3
250
Data reduction pipelines using Docker for the MeerKAT telescope
gijzelaerr
0
110
Other Decks in Science
See All in Science
データベース04: SQL (1/3) 単純質問 & 集約演算
trycycle
PRO
0
890
データベース01: データベースを使わない世界
trycycle
PRO
1
690
データベース03: 関係データモデル
trycycle
PRO
1
140
マウス肝炎ウイルス感染の遺伝子発現へのテンソル分解の適用によるSARS-CoV-2感染関連重要ヒト遺伝子と有効な薬剤の同定
tagtag
0
120
ガウス過程回帰とベイズ最適化
nearme_tech
PRO
1
470
3次元点群を利用した植物の葉の自動セグメンテーションについて
kentaitakura
2
1.3k
学術講演会中央大学学員会府中支部
tagtag
0
290
ウェブ・ソーシャルメディア論文読み会 第25回: Differences in misinformation sharing can lead to politically asymmetric sanctions (Nature, 2024)
hkefka385
0
120
A Guide to Academic Writing Using Generative AI - A Workshop
ks91
PRO
0
120
機械学習 - 授業概要
trycycle
PRO
0
210
オンプレミス環境にKubernetesを構築する
koukimiura
0
290
baseballrによるMLBデータの抽出と階層ベイズモデルによる打率の推定 / TokyoR118
dropout009
1
520
Featured
See All Featured
Six Lessons from altMBA
skipperchong
28
3.9k
実際に使うSQLの書き方 徹底解説 / pgcon21j-tutorial
soudai
PRO
181
54k
ReactJS: Keep Simple. Everything can be a component!
pedronauck
667
120k
Principles of Awesome APIs and How to Build Them.
keavy
126
17k
Product Roadmaps are Hard
iamctodd
PRO
54
11k
Fashionably flexible responsive web design (full day workshop)
malarkey
407
66k
No one is an island. Learnings from fostering a developers community.
thoeni
21
3.4k
Code Review Best Practice
trishagee
69
19k
Creating an realtime collaboration tool: Agile Flush - .NET Oxford
marcduiker
30
2.2k
KATA
mclloyd
30
14k
Building a Modern Day E-commerce SEO Strategy
aleyda
42
7.4k
Fantastic passwords and where to find them - at NoRuKo
philnash
51
3.3k
Transcript
Machine Learning and Simulations for Asset Management March 13, 2020,
NL-RSE Meetup Gijs Molenaar
pythonic.nl • Me! • Freelance Software/Research Engineer • MSc AI
(UvA) • PhD astronomy (South Africa)
• Public Utility company • 5.7 million client connections •
5700 FTE
None
None
The problem • Fixed budget • How to optimally distribute
budget over departments • Balance between long term and short term goals
Amsterdam • Go fully electric by 2030 • 900.000 people
• 230.000 private cars • 10 years • 2610 working days • 1000 charging stations a day?
Our solution • Build agent based simulation of company •
Run millions of simulations up to 40 years in the future • Let Reinforcement Learning agent explore and optimize problem space
What do we need? • A physical model • A
bunch of agents manipulating this model
None
None
Reinforcement Learning
Reinforcement Learning st st+1 a
Deep-Q learning Simulation agent != Reinforcent learning Agent
State • Number of connection issues Reward • function of
• Budget spend • Average waiting time for new connection • Average Waiting time for fix of broken connection Action Decision of budget split
Project structure • 3 teams: • Data Engineers • Data
Scientists • Software Engineers
None
Evaluating 2 strategies • Compute in neo4j • Compute in
NumPy + NetworkIt
None
Rpy2 R has NA values in int arrays, numpy has
NaN in float arrays
Status report • Still working on simulations • Underestimated the
effort required to get this right • Maybe too ambitious? • Useful nonetheless
Research Engineer in Corporate environment • Different setting • Requires
different mindset • More budget • A lot of politics
pythonic.nl available again! • 1 June 2020 • First getting
married in Namibia • If we don’t get Corona banned
Questions?