Upgrade to PRO for Only $50/Year—Limited-Time Offer! 🔥

Interactive big data analysis with Jupyter, Das...

Avatar for Jacob Tomlinson Jacob Tomlinson
June 27, 2017
Technology
0
130

Interactive big data analysis with Jupyter, Dask and more

JASMIN conf 2017.

Avatar for Jacob Tomlinson

Jacob Tomlinson

June 27, 2017
Tweet

More Decks by Jacob Tomlinson

See All by Jacob Tomlinson
EffVer - Version your code by the effort required to upgrade
Avatar for Jacob Tomlinson jacobtomlinson
0
25
Tech Exeter - Intro to Kubernetes 10 Year Update
Avatar for Jacob Tomlinson jacobtomlinson
0
46
Who Builds the PyData Ecosystem?
Avatar for Jacob Tomlinson jacobtomlinson
0
68
The Art of Wrangling Your GPU Python Environments
Avatar for Jacob Tomlinson jacobtomlinson
0
64
Getting science done with accelerated Python computing platforms
Avatar for Jacob Tomlinson jacobtomlinson
0
64
Dask on HPC in 2024 - Lightning Talk
Avatar for Jacob Tomlinson jacobtomlinson
0
79
GPU Acceleration in the PyData community
Avatar for Jacob Tomlinson jacobtomlinson
0
79
Dask on HPC in 2024
Avatar for Jacob Tomlinson jacobtomlinson
0
58
GPU Acceleration in the PyData community
Avatar for Jacob Tomlinson jacobtomlinson
0
57

Other Decks in Technology

See All in Technology
20251209_WAKECareer_生成AIを活用した設計・開発プロセス
Avatar for syobochim syobochim
5
1.4k
グレートファイアウォールを自宅に建てよう
Avatar for 綿糸てせ ctes091x
0
140
AWSセキュリティアップデートとAWSを育てる話
Avatar for cm-usuda-keisuke cmusudakeisuke
0
130
世界最速級 memcached 互換サーバー作った
Avatar for yasukata yasukata
0
330
直接メモリアクセス
Avatar for KOBA789 koba789
0
290
意外とあった SQL Server 関連アップデート + Database Savings Plans
Avatar for Takuya Shibata stknohg
PRO
0
300
regrowth_tokyo_2025_securityagent
Avatar for h-ashisan hiashisan
0
190
[JAWS-UG 横浜支部 #91]DevOps Agent vs CloudWatch Investigations -比較と実践-
Avatar for sh_fk2 sh_fk2
1
240
Lambdaの常識はどう変わる？！re:Invent 2025 before after
Avatar for TomoyaIwata iwatatomoya
1
390
エンジニアリングマネージャー はじめての目標設定と評価
Avatar for d-haru halkt
0
260
因果AIへの招待
Avatar for Shohei SHIMIZU sshimizu2006
0
930
pmconf2025 - データを活用し「価値」へ繋げる
Avatar for Emy - Emiko Yoshihara glorypulse
0
710

Featured

See All Featured
[SF Ruby Conf 2025] Rails X
Avatar for Vladimir Dementyev palkan
0
500
jQuery: Nuts, Bolts and Bling
Avatar for Doug Neiner dougneiner
65
8.2k
[RailsConf 2023 Opening Keynote] The Magic of Rails
Avatar for Eileen M. Uchitelle eileencodes
31
9.8k
Raft: Consensus for Rubyists
Avatar for Patrick Van Stee vanstee
141
7.2k
RailsConf & Balkan Ruby 2019: The Past, Present, and Future of Rails at GitHub
Avatar for Eileen M. Uchitelle eileencodes
141
34k
Design and Strategy: How to Deal with People Who Don’t "Get" Design
Avatar for Morgane Peng morganepeng
132
19k
Speed Design
Avatar for Sergey Chernyshev sergeychernyshev
33
1.4k
Practical Tips for Bootstrapping Information Extraction Pipelines
Avatar for Matthew Honnibal honnibal
25
1.6k
StorybookのUI Testing Handbookを読んだ
Avatar for Shingo Yamazaki zakiyama
31
6.4k
Optimising Largest Contentful Paint
Avatar for Harry Roberts csswizardry
37
3.5k
The Psychology of Web Performance [Beyond Tellerrand 2023]
Avatar for Tammy Everts tammyeverts
49
3.2k
Designing Dashboards & Data Visualisations in Web Apps
Avatar for Des Traynor destraynor
231
54k

Transcript

  1. Interactive big data analysis with Jupyter, Dask and more Jacob

    Tomlinson Lead Engineer Met Office Informatics Lab

  2. .@_jacobtomlinson. .linux. .bash. .cloud. .sysadmin. .web development. .docker. .javascript. .git.

    .public speaking. .CI/CD. .automation. .python.
  3. None
  4. None

  5. Processing data at scale

  6. None
  7. None

  8. Iris

  9. None

  10. Laziness

  11. .Currently storing 40PB. .Archiving 200TB per day. .Will store 300PB

    by 2020. *Approx figures - early 2017
  12. None
  13. None

  14. The tools

  15. None
  16. None
  17. None
  18. None

  19. Iris

  20. None
  21. None
  22. None
  23. None
  24. None
  25. None
  26. None
  27. None
  28. None

  29. Summary

  30. Thank you Jacob Tomlinson www.informaticslab.co.uk @_jacobtomlinson