Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Interactive big data analysis with Jupyter, Das...

Avatar for Jacob Tomlinson Jacob Tomlinson
June 27, 2017
Technology
0
130

Interactive big data analysis with Jupyter, Dask and more

JASMIN conf 2017.

Avatar for Jacob Tomlinson

Jacob Tomlinson

June 27, 2017
Tweet

More Decks by Jacob Tomlinson

See All by Jacob Tomlinson
EffVer - Version your code by the effort required to upgrade
Avatar for Jacob Tomlinson jacobtomlinson
0
17
Tech Exeter - Intro to Kubernetes 10 Year Update
Avatar for Jacob Tomlinson jacobtomlinson
0
37
Who Builds the PyData Ecosystem?
Avatar for Jacob Tomlinson jacobtomlinson
0
55
The Art of Wrangling Your GPU Python Environments
Avatar for Jacob Tomlinson jacobtomlinson
0
57
Getting science done with accelerated Python computing platforms
Avatar for Jacob Tomlinson jacobtomlinson
0
56
Dask on HPC in 2024 - Lightning Talk
Avatar for Jacob Tomlinson jacobtomlinson
0
69
GPU Acceleration in the PyData community
Avatar for Jacob Tomlinson jacobtomlinson
0
67
Dask on HPC in 2024
Avatar for Jacob Tomlinson jacobtomlinson
0
43
GPU Acceleration in the PyData community
Avatar for Jacob Tomlinson jacobtomlinson
0
47

Other Decks in Technology

See All in Technology
AWS UG Grantでグローバル20名に選出されてre:Inventに行く話と、マルチクラウドセキュリティの教科書を執筆した話 / The Story of Being Selected for the AWS UG Grant to Attending re:Invent, and Writing a Multi-Cloud Security Textbook
Avatar for Yuji Oshima yuj1osm
1
130
Introduction to Sansan, inc / Sansan Global Development Center, Inc.
Avatar for Sansan, Inc. sansan33
PRO
0
2.8k
ソースを読むプロセスの例
Avatar for Satoru Takeuchi sat
PRO
15
9.8k
SQLAlchemy の select(User).where(User.id =="123") を理解してみる/sqlalchemy deep dive
Avatar for Ryusei Ohkura 3l4l5
3
290
ローカルLLMとLINE Botの組み合わせ その2（EVO-X2でgpt-oss-120bを利用） / LINE DC Generative AI Meetup #7
Avatar for you（@youtoy） you
PRO
0
150
ViteとTypeScriptのProject Referencesで 大規模モノレポのUIカタログのリリースサイクルを高速化する
Avatar for did0es shuta13
2
160
「改善」ってこれでいいんだっけ？
Avatar for うきぐも / すずき ukigmo_hiro
0
410
Dylib Hijacking on macOS: Dead or Alive?
Avatar for Patrick Wardle patrickwardle
0
450
「REALITY」3Dアバターシステムの7年分の拡張の歴史について
Avatar for gree_tech gree_tech
PRO
0
130
「魔法少女まどか☆マギカ Magia Exedra」のIPのキャラクターを描くための3Dルック開発
Avatar for gree_tech gree_tech
PRO
0
170
物体検出モデルでシイタケの収穫時期を自動判定してみた。 #devio2025
Avatar for Lamaglama39 lamaglama39
0
280
組織改革から開発効率向上まで！ - 成功事例から見えたAI活用のポイント - / 20251016 Tetsuharu Kokaki
Avatar for SHIFT EVOLVE shift_evolve
PRO
2
230

Featured

See All Featured
The Pragmatic Product Professional
Avatar for Laura Van Doore lauravandoore
36
7k
Understanding Cognitive Biases in Performance Measurement
Avatar for Philip Tellis bluesmoon
31
2.7k
A Tale of Four Properties
Avatar for Chris Coyier chriscoyier
161
23k
4 Signs Your Business is Dying
Avatar for Josh Pigford shpigford
185
22k
How To Stay Up To Date on Web Technology
Avatar for Chris Coyier chriscoyier
791
250k
Optimizing for Happiness
Avatar for Tom Preston-Werner mojombo
379
70k
Exploring the Power of Turbo Streams & Action Cable | RailsConf2023
Avatar for Kevin Liebholz kevinliebholz
36
6.1k
Save Time (by Creating Custom Rails Generators)
Avatar for Garrett Dimon garrettdimon
PRO
32
1.7k
KATA
Avatar for Megan Lloyd mclloyd
PRO
32
15k
Fashionably flexible responsive web design (full day workshop)
Avatar for Andy Clarke malarkey
407
66k
Measuring & Analyzing Core Web Vitals
Avatar for Philip Tellis bluesmoon
9
630
Responsive Adventures: Dirty Tricks From The Dark Corners of Front-End
Avatar for Vitaly Friedman smashingmag
253
22k

Transcript

  1. Interactive big data analysis with Jupyter, Dask and more Jacob

    Tomlinson Lead Engineer Met Office Informatics Lab

  2. .@_jacobtomlinson. .linux. .bash. .cloud. .sysadmin. .web development. .docker. .javascript. .git.

    .public speaking. .CI/CD. .automation. .python.
  3. None
  4. None

  5. Processing data at scale

  6. None
  7. None

  8. Iris

  9. None

  10. Laziness

  11. .Currently storing 40PB. .Archiving 200TB per day. .Will store 300PB

    by 2020. *Approx figures - early 2017
  12. None
  13. None

  14. The tools

  15. None
  16. None
  17. None
  18. None

  19. Iris

  20. None
  21. None
  22. None
  23. None
  24. None
  25. None
  26. None
  27. None
  28. None

  29. Summary

  30. Thank you Jacob Tomlinson www.informaticslab.co.uk @_jacobtomlinson