Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Interactive big data analysis with Jupyter, Das...

Avatar for Jacob Tomlinson Jacob Tomlinson
June 27, 2017
Technology
0
130

Interactive big data analysis with Jupyter, Dask and more

JASMIN conf 2017.
Avatar for Jacob Tomlinson

Jacob Tomlinson

June 27, 2017
Tweet

More Decks by Jacob Tomlinson

See All by Jacob Tomlinson
Tech Exeter - Intro to Kubernetes 10 Year Update
Avatar for Jacob Tomlinson jacobtomlinson
0
14
Who Builds the PyData Ecosystem?
Avatar for Jacob Tomlinson jacobtomlinson
0
28
The Art of Wrangling Your GPU Python Environments
Avatar for Jacob Tomlinson jacobtomlinson
0
42
Getting science done with accelerated Python computing platforms
Avatar for Jacob Tomlinson jacobtomlinson
0
35
Dask on HPC in 2024 - Lightning Talk
Avatar for Jacob Tomlinson jacobtomlinson
0
48
GPU Acceleration in the PyData community
Avatar for Jacob Tomlinson jacobtomlinson
0
45
Dask on HPC in 2024
Avatar for Jacob Tomlinson jacobtomlinson
0
25
GPU Acceleration in the PyData community
Avatar for Jacob Tomlinson jacobtomlinson
0
27
When to rebuild things that already exist
Avatar for Jacob Tomlinson jacobtomlinson
0
31

Other Decks in Technology

See All in Technology
Microsoft Build 2025 技術/製品動向 for Microsoft Startup Tech Community
Avatar for Toru Makabe torumakabe
2
320
AWS Summit Japan 2025 Community Stage - App workflow automation by AWS Step Functions
Avatar for matsuihidetoshi matsuihidetoshi
1
300
2025-06-26 GitHub CopilotとAI駆動開発：実践と導入のリアル
Avatar for 河内崇 fl_kawachi
1
200
How Community Opened Global Doors
Avatar for hiroramos hiroramos4
PRO
1
130
Wasm元年
Avatar for asuka askua
0
160
Fabric ＋ Databricks 2025.6 の最新情報ピックアップ
Avatar for Ryoma Nagata ryomaru0825
1
150
TechLION vol.41～MySQLユーザ会のほうから来ました / techlion41_mysql
Avatar for sakaik sakaik
0
200
使いたいMCPサーバーはWeb APIをラップして自分で作る #QiitaBash
Avatar for 弁護士ドットコム bengo4com
0
1k
Tech-Verse 2025 Keynote
Avatar for LINEヤフーTech (LY Corporation Tech) lycorptech_jp
PRO
0
1.1k
解析の定理証明実践＠Lean 4
Avatar for H Segawa dec9ue
1
190
Prox Industries株式会社 会社紹介資料
Avatar for Prox proxindustries
0
340
KubeCon + CloudNativeCon Japan 2025 Recap Opening & Choose Your Own Adventureシリーズまとめ
Avatar for mm-matsuda mmmatsuda
0
220

Featured

See All Featured
GraphQLとの向き合い方2022年版
Avatar for Yosuke Kurami quramy
49
14k
Chrome DevTools: State of the Union 2024 - Debugging React & Beyond
Avatar for Addy Osmani addyosmani
7
720
Bash Introduction
Avatar for André Augusto Costa Santos 62gerente
614
210k
jQuery: Nuts, Bolts and Bling
Avatar for Doug Neiner dougneiner
63
7.8k
Building a Scalable Design System with Sketch
Avatar for Laura Van Doore lauravandoore
462
33k
StorybookのUI Testing Handbookを読んだ
Avatar for Shingo Yamazaki zakiyama
30
5.8k
Writing Fast Ruby
Avatar for Erik Berlin sferik
628
62k
BBQ
Avatar for Matthew Crist matthewcrist
89
9.7k
For a Future-Friendly Web
Avatar for Brad Frost brad_frost
179
9.8k
Automating Front-end Workflow
Avatar for Addy Osmani addyosmani
1370
200k
Optimising Largest Contentful Paint
Avatar for Harry Roberts csswizardry
37
3.3k
Docker and Python
Avatar for Tania Allard trallard
44
3.4k

Transcript

  1. Interactive big data analysis with Jupyter, Dask and more Jacob

    Tomlinson Lead Engineer Met Office Informatics Lab

  2. .@_jacobtomlinson. .linux. .bash. .cloud. .sysadmin. .web development. .docker. .javascript. .git.

    .public speaking. .CI/CD. .automation. .python.
  3. None
  4. None

  5. Processing data at scale

  6. None
  7. None

  8. Iris

  9. None

  10. Laziness

  11. .Currently storing 40PB. .Archiving 200TB per day. .Will store 300PB

    by 2020. *Approx figures - early 2017
  12. None
  13. None

  14. The tools

  15. None
  16. None
  17. None
  18. None

  19. Iris

  20. None
  21. None
  22. None
  23. None
  24. None
  25. None
  26. None
  27. None
  28. None

  29. Summary

  30. Thank you Jacob Tomlinson www.informaticslab.co.uk @_jacobtomlinson