Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Machine Learning and Simulations for Asset Mana...
Search
Gijs Molenaar
March 13, 2020
Science
1
91
Machine Learning and Simulations for Asset Management at Alliander
Gijs Molenaar
March 13, 2020
Tweet
Share
More Decks by Gijs Molenaar
See All by Gijs Molenaar
Easy to deploy and easy to modify data reduction pipelines using KERN and CWL
gijzelaerr
1
74
Research Engineering in Radio Astronomy
gijzelaerr
3
120
The story of CWLifying Apercal
gijzelaerr
0
97
Deep Vacuum Cleaner
gijzelaerr
1
74
EOSC LOFAR pilot final presentation
gijzelaerr
1
160
Software packaging and data pipelines
gijzelaerr
1
160
Docker - 3 years later
gijzelaerr
0
170
Radio astronomy data reduction at PyData Amsterdam
gijzelaerr
3
260
Data reduction pipelines using Docker for the MeerKAT telescope
gijzelaerr
0
110
Other Decks in Science
See All in Science
データベース06: SQL (3/3) 副問い合わせ
trycycle
PRO
1
640
mOrganic™ Holdings, LLC.
hyperlocalnetwork
0
120
機械学習 - DBSCAN
trycycle
PRO
0
1.1k
デジタルアーカイブの教育利用促進を目指したメタデータLOD基盤に関する研究 / Research on a Metadata LOD Platform for Promoting Educational Uses of Digital Archives
masao
0
100
データベース01: データベースを使わない世界
trycycle
PRO
1
800
baseballrによるMLBデータの抽出と階層ベイズモデルによる打率の推定 / TokyoR118
dropout009
2
580
データマイニング - ウェブとグラフ
trycycle
PRO
0
180
知能とはなにかーヒトとAIのあいだー
tagtag
0
140
Masseyのレーティングを用いたフォーミュラレースドライバーの実績評価手法の開発 / Development of a Performance Evaluation Method for Formula Race Drivers Using Massey Ratings
konakalab
0
200
データベース15: ビッグデータ時代のデータベース
trycycle
PRO
0
360
安心・効率的な医療現場の実現へ ~オンプレAI & ノーコードワークフローで進める業務改革~
siyoo
0
360
Hakonwa-Quaternion
hiranabe
1
140
Featured
See All Featured
Building Adaptive Systems
keathley
43
2.8k
The Straight Up "How To Draw Better" Workshop
denniskardys
237
140k
Being A Developer After 40
akosma
91
590k
A better future with KSS
kneath
239
18k
Testing 201, or: Great Expectations
jmmastey
45
7.7k
Put a Button on it: Removing Barriers to Going Fast.
kastner
60
4k
ピンチをチャンスに:未来をつくるプロダクトロードマップ #pmconf2020
aki_iinuma
127
53k
Building Applications with DynamoDB
mza
96
6.7k
The Cult of Friendly URLs
andyhume
79
6.6k
[RailsConf 2023] Rails as a piece of cake
palkan
57
5.9k
Evolution of real-time – Irina Nazarova, EuRuKo, 2024
irinanazarova
9
970
VelocityConf: Rendering Performance Case Studies
addyosmani
332
24k
Transcript
Machine Learning and Simulations for Asset Management March 13, 2020,
NL-RSE Meetup Gijs Molenaar
pythonic.nl • Me! • Freelance Software/Research Engineer • MSc AI
(UvA) • PhD astronomy (South Africa)
• Public Utility company • 5.7 million client connections •
5700 FTE
None
None
The problem • Fixed budget • How to optimally distribute
budget over departments • Balance between long term and short term goals
Amsterdam • Go fully electric by 2030 • 900.000 people
• 230.000 private cars • 10 years • 2610 working days • 1000 charging stations a day?
Our solution • Build agent based simulation of company •
Run millions of simulations up to 40 years in the future • Let Reinforcement Learning agent explore and optimize problem space
What do we need? • A physical model • A
bunch of agents manipulating this model
None
None
Reinforcement Learning
Reinforcement Learning st st+1 a
Deep-Q learning Simulation agent != Reinforcent learning Agent
State • Number of connection issues Reward • function of
• Budget spend • Average waiting time for new connection • Average Waiting time for fix of broken connection Action Decision of budget split
Project structure • 3 teams: • Data Engineers • Data
Scientists • Software Engineers
None
Evaluating 2 strategies • Compute in neo4j • Compute in
NumPy + NetworkIt
None
Rpy2 R has NA values in int arrays, numpy has
NaN in float arrays
Status report • Still working on simulations • Underestimated the
effort required to get this right • Maybe too ambitious? • Useful nonetheless
Research Engineer in Corporate environment • Different setting • Requires
different mindset • More budget • A lot of politics
pythonic.nl available again! • 1 June 2020 • First getting
married in Namibia • If we don’t get Corona banned
Questions?