Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Interactive big data analysis with Jupyter, Das...

Avatar for Jacob Tomlinson Jacob Tomlinson
June 27, 2017
Technology
0
130

Interactive big data analysis with Jupyter, Dask and more

JASMIN conf 2017.

Avatar for Jacob Tomlinson

Jacob Tomlinson

June 27, 2017
Tweet

More Decks by Jacob Tomlinson

See All by Jacob Tomlinson
EffVer - Version your code by the effort required to upgrade
Avatar for Jacob Tomlinson jacobtomlinson
0
49
Tech Exeter - Intro to Kubernetes 10 Year Update
Avatar for Jacob Tomlinson jacobtomlinson
0
56
Who Builds the PyData Ecosystem?
Avatar for Jacob Tomlinson jacobtomlinson
0
89
The Art of Wrangling Your GPU Python Environments
Avatar for Jacob Tomlinson jacobtomlinson
0
79
Getting science done with accelerated Python computing platforms
Avatar for Jacob Tomlinson jacobtomlinson
2
120
Dask on HPC in 2024 - Lightning Talk
Avatar for Jacob Tomlinson jacobtomlinson
0
93
GPU Acceleration in the PyData community
Avatar for Jacob Tomlinson jacobtomlinson
0
92
Dask on HPC in 2024
Avatar for Jacob Tomlinson jacobtomlinson
0
80
GPU Acceleration in the PyData community
Avatar for Jacob Tomlinson jacobtomlinson
0
72

Other Decks in Technology

See All in Technology
今日から始める Amazon Bedrock AgentCore
Avatar for Har1101 har1101
4
420
Red Hat OpenStack Services on OpenShift
Avatar for Tatsuya Amemiya tamemiya
0
120
レガシー共有バッチ基盤への挑戦 - SREドリブンなリアーキテクチャリングの取り組み
Avatar for Konishi tatsuhiro tatsukoni
0
220
AzureでのIaC - Bicep? Terraform? それ早く言ってよ会議
Avatar for Toru Makabe torumakabe
1
590
超初心者からでも大丈夫！オープンソース半導体の楽しみ方〜今こそ！オレオレチップをつくろう〜
Avatar for Yamada3 keropiyo
0
120
Embedded SREの終わりを設計する　「なんとなく」から計画的な自立支援へ
Avatar for SansanTech sansantech
PRO
3
2.6k
日本の85%が使う公共SaaSは、どう育ったのか
Avatar for たけだ taketakekaho
1
230
Ruby版 JSXのRuxが気になる
Avatar for SansanTech sansantech
PRO
0
160
プロダクト成長を支える開発基盤とスケールに伴う課題
Avatar for yuu26 yuu26
4
1.4k
コミュニティが変えるキャリアの地平線：コロナ禍新卒入社のエンジニアがAWSコミュニティで見つけた成長の羅針盤
Avatar for Kento Suzuki kentosuzuki
0
130
こんなところでも（地味に）活躍するImage Modeさんを知ってるかい？- Image Mode for OpenShift -
Avatar for Masataka Tsukamoto tsukaman
1
160
茨城の思い出を振り返る ～CDKのセキュリティを添えて～ / 20260201 Mitsutoshi Matsuo
Avatar for SHIFT EVOLVE shift_evolve
PRO
1
360

Featured

See All Featured
Future Trends and Review - Lecture 12 - Web Technologies (1019888BNR)
Avatar for Beat Signer signer
PRO
0
3.2k
The SEO Collaboration Effect
Avatar for Kristina Bergwall kristinabergwall1
0
350
HU Berlin: Industrial-Strength Natural Language Processing with spaCy and Prodigy
Avatar for Ines Montani inesmontani
PRO
0
220
Odyssey Design
Avatar for Ryan Kendrick rkendrick25
PRO
1
500
Measuring & Analyzing Core Web Vitals
Avatar for Philip Tellis bluesmoon
9
760
Heart Work Chapter 1 - Part 1
Avatar for Lake Fama lfama
PRO
5
35k
Testing 201, or: Great Expectations
Avatar for Joseph Mastey jmmastey
46
8k
Evolving SEO for Evolving Search Engines
Avatar for Ryan Jones ryanjones
0
130
The Language of Interfaces
Avatar for Des Traynor destraynor
162
26k
Chasing Engaging Ingredients in Design
Avatar for Sebastian Deterding codingconduct
0
110
Designing Powerful Visuals for Engaging Learning
Avatar for Mike Taylor tmiket
0
240
Bridging the Design Gap: How Collaborative Modelling removes blockers to flow between stakeholders and teams @FastFlow conf
Avatar for Kenny Baas-Schwegler baasie
0
450

Transcript

  1. Interactive big data analysis with Jupyter, Dask and more Jacob

    Tomlinson Lead Engineer Met Office Informatics Lab

  2. .@_jacobtomlinson. .linux. .bash. .cloud. .sysadmin. .web development. .docker. .javascript. .git.

    .public speaking. .CI/CD. .automation. .python.
  3. None
  4. None

  5. Processing data at scale

  6. None
  7. None

  8. Iris

  9. None

  10. Laziness

  11. .Currently storing 40PB. .Archiving 200TB per day. .Will store 300PB

    by 2020. *Approx figures - early 2017
  12. None
  13. None

  14. The tools

  15. None
  16. None
  17. None
  18. None

  19. Iris

  20. None
  21. None
  22. None
  23. None
  24. None
  25. None
  26. None
  27. None
  28. None

  29. Summary

  30. Thank you Jacob Tomlinson www.informaticslab.co.uk @_jacobtomlinson