Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Interactive big data analysis with Jupyter, Das...

Avatar for Jacob Tomlinson Jacob Tomlinson
June 27, 2017
Technology
0
130

Interactive big data analysis with Jupyter, Dask and more

JASMIN conf 2017.

Avatar for Jacob Tomlinson

Jacob Tomlinson

June 27, 2017
Tweet

More Decks by Jacob Tomlinson

See All by Jacob Tomlinson
EffVer - Version your code by the effort required to upgrade
Avatar for Jacob Tomlinson jacobtomlinson
0
5
Tech Exeter - Intro to Kubernetes 10 Year Update
Avatar for Jacob Tomlinson jacobtomlinson
0
27
Who Builds the PyData Ecosystem?
Avatar for Jacob Tomlinson jacobtomlinson
0
36
The Art of Wrangling Your GPU Python Environments
Avatar for Jacob Tomlinson jacobtomlinson
0
50
Getting science done with accelerated Python computing platforms
Avatar for Jacob Tomlinson jacobtomlinson
0
46
Dask on HPC in 2024 - Lightning Talk
Avatar for Jacob Tomlinson jacobtomlinson
0
60
GPU Acceleration in the PyData community
Avatar for Jacob Tomlinson jacobtomlinson
0
56
Dask on HPC in 2024
Avatar for Jacob Tomlinson jacobtomlinson
0
32
GPU Acceleration in the PyData community
Avatar for Jacob Tomlinson jacobtomlinson
0
38

Other Decks in Technology

See All in Technology
どこで動かすか、誰が動かすか 〜 kintoneのインフラ基盤刷新と運用体制のシフト 〜
Avatar for Shin'ya Ueoka ueokande
0
170
Gaze-LLE: Gaze Target Estimation via Large-Scale Learned Encoders
Avatar for Kazuyuki Miyazawa kzykmyzw
0
300
datadog-distribution-of-opentelemetry-collector-intro
Avatar for tetsuya28 tetsuya28
0
240
Yahoo!ニュースにおけるソフトウェア開発
Avatar for LINEヤフーTech (LY Corporation Tech) lycorptech_jp
PRO
0
260
Oracle Base Database Service：サービス概要のご紹介
Avatar for oracle4engineer oracle4engineer
PRO
2
20k
生成AI活用のROI、どう測る？ DMM.com 開発責任者から学ぶ「AI効果検証のノウハウ」 / ROI of AI
Avatar for Masato Ishigaki / 石垣雅人 i35_267
4
150
Claude Code x Androidアプリ 開発
Avatar for Shinnosuke Kugimiya kgmyshin
1
530
メルカリIBIS：AIが拓く次世代インシデント対応
Avatar for ktykogm 0gm
2
510
Goでマークダウンの独自記法を実装する
Avatar for lag129 lag129
0
210
ウォンテッドリーのアラート設計と Datadog 移行での知見
Avatar for Kazuki Obata donkomura
0
300
Delegate authentication and a lot more to Keycloak with OpenID Connect
Avatar for Alexander Schwartz ahus1
0
240
Goss: Faiss向けの新しい本番環境対応 Goバインディング #coefl_go_jp
Avatar for 弁護士ドットコム bengo4com
0
1.1k

Featured

See All Featured
KATA
Avatar for Megan Lloyd mclloyd
32
14k
Refactoring Trust on Your Teams (GOTO; Chicago 2020)
Avatar for Rebecca Miller-Webster rmw
34
3.1k
Side Projects
Avatar for Sacha Greif sachag
455
43k
The Straight Up "How To Draw Better" Workshop
Avatar for Dennis Kardys denniskardys
236
140k
Six Lessons from altMBA
Avatar for Skipper Chong Warson skipperchong
28
4k
The Invisible Side of Design
Avatar for Vitaly Friedman smashingmag
301
51k
Speed Design
Avatar for Sergey Chernyshev sergeychernyshev
32
1.1k
Imperfection Machines: The Place of Print at Facebook
Avatar for Scott Boms scottboms
268
13k
Evolution of real-time – Irina Nazarova, EuRuKo, 2024
Avatar for Irina Nazarova irinanazarova
8
890
Facilitating Awesome Meetings
Avatar for Lara Hogan lara
55
6.5k
Building Better People: How to give real-time feedback that sticks.
Avatar for Will Jessup wjessup
367
19k
Why Our Code Smells
Avatar for Brandon Keepers bkeepers
PRO
338
57k

Transcript

  1. Interactive big data analysis with Jupyter, Dask and more Jacob

    Tomlinson Lead Engineer Met Office Informatics Lab

  2. .@_jacobtomlinson. .linux. .bash. .cloud. .sysadmin. .web development. .docker. .javascript. .git.

    .public speaking. .CI/CD. .automation. .python.
  3. None
  4. None

  5. Processing data at scale

  6. None
  7. None

  8. Iris

  9. None

  10. Laziness

  11. .Currently storing 40PB. .Archiving 200TB per day. .Will store 300PB

    by 2020. *Approx figures - early 2017
  12. None
  13. None

  14. The tools

  15. None
  16. None
  17. None
  18. None

  19. Iris

  20. None
  21. None
  22. None
  23. None
  24. None
  25. None
  26. None
  27. None
  28. None

  29. Summary

  30. Thank you Jacob Tomlinson www.informaticslab.co.uk @_jacobtomlinson