Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Machine Learning and Simulations for Asset Mana...
Search
Gijs Molenaar
March 13, 2020
Science
1
91
Machine Learning and Simulations for Asset Management at Alliander
Gijs Molenaar
March 13, 2020
Tweet
Share
More Decks by Gijs Molenaar
See All by Gijs Molenaar
Easy to deploy and easy to modify data reduction pipelines using KERN and CWL
gijzelaerr
1
75
Research Engineering in Radio Astronomy
gijzelaerr
3
120
The story of CWLifying Apercal
gijzelaerr
0
97
Deep Vacuum Cleaner
gijzelaerr
1
74
EOSC LOFAR pilot final presentation
gijzelaerr
1
160
Software packaging and data pipelines
gijzelaerr
1
160
Docker - 3 years later
gijzelaerr
0
170
Radio astronomy data reduction at PyData Amsterdam
gijzelaerr
3
260
Data reduction pipelines using Docker for the MeerKAT telescope
gijzelaerr
0
110
Other Decks in Science
See All in Science
アナログ計算機『計算尺』を愛でる Midosuji Tech #4/Analog Computing Device Slide Rule now and then
quiver
1
310
LayerXにおける業務の完全自動運転化に向けたAI技術活用事例 / layerx-ai-jsai2025
shimacos
2
16k
Cross-Media Technologies, Information Science and Human-Information Interaction
signer
PRO
3
31k
データベース10: 拡張実体関連モデル
trycycle
PRO
0
1k
02_西村訓弘_プログラムディレクター_人口減少を機にひらく未来社会.pdf
sip3ristex
0
660
テンソル分解による糖尿病の組織特異的遺伝子発現の統合解析を用いた関連疾患の予測
tagtag
2
280
Quelles valorisations des logiciels vers le monde socio-économique dans un contexte de Science Ouverte ?
bluehats
1
550
機械学習 - DBSCAN
trycycle
PRO
0
1.1k
mOrganic™ Holdings, LLC.
hyperlocalnetwork
0
120
なぜ21は素因数分解されないのか? - Shorのアルゴリズムの現在と壁
daimurat
0
120
知能とはなにかーヒトとAIのあいだー
tagtag
0
100
サイゼミ用因果推論
lw
1
7.6k
Featured
See All Featured
A Tale of Four Properties
chriscoyier
161
23k
Visualizing Your Data: Incorporating Mongo into Loggly Infrastructure
mongodb
48
9.7k
Principles of Awesome APIs and How to Build Them.
keavy
127
17k
Gamification - CAS2011
davidbonilla
81
5.5k
How to Think Like a Performance Engineer
csswizardry
27
2.1k
The World Runs on Bad Software
bkeepers
PRO
72
11k
Easily Structure & Communicate Ideas using Wireframe
afnizarnur
194
16k
Music & Morning Musume
bryan
46
6.9k
Intergalactic Javascript Robots from Outer Space
tanoku
272
27k
How to train your dragon (web standard)
notwaldorf
97
6.3k
Optimising Largest Contentful Paint
csswizardry
37
3.5k
Leading Effective Engineering Teams in the AI Era
addyosmani
7
620
Transcript
Machine Learning and Simulations for Asset Management March 13, 2020,
NL-RSE Meetup Gijs Molenaar
pythonic.nl • Me! • Freelance Software/Research Engineer • MSc AI
(UvA) • PhD astronomy (South Africa)
• Public Utility company • 5.7 million client connections •
5700 FTE
None
None
The problem • Fixed budget • How to optimally distribute
budget over departments • Balance between long term and short term goals
Amsterdam • Go fully electric by 2030 • 900.000 people
• 230.000 private cars • 10 years • 2610 working days • 1000 charging stations a day?
Our solution • Build agent based simulation of company •
Run millions of simulations up to 40 years in the future • Let Reinforcement Learning agent explore and optimize problem space
What do we need? • A physical model • A
bunch of agents manipulating this model
None
None
Reinforcement Learning
Reinforcement Learning st st+1 a
Deep-Q learning Simulation agent != Reinforcent learning Agent
State • Number of connection issues Reward • function of
• Budget spend • Average waiting time for new connection • Average Waiting time for fix of broken connection Action Decision of budget split
Project structure • 3 teams: • Data Engineers • Data
Scientists • Software Engineers
None
Evaluating 2 strategies • Compute in neo4j • Compute in
NumPy + NetworkIt
None
Rpy2 R has NA values in int arrays, numpy has
NaN in float arrays
Status report • Still working on simulations • Underestimated the
effort required to get this right • Maybe too ambitious? • Useful nonetheless
Research Engineer in Corporate environment • Different setting • Requires
different mindset • More budget • A lot of politics
pythonic.nl available again! • 1 June 2020 • First getting
married in Namibia • If we don’t get Corona banned
Questions?