Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Interactive big data analysis with Jupyter, Das...

Sponsored · SiteGround - Reliable hosting with speed, security, and support you can count on. →
Avatar for Jacob Tomlinson Jacob Tomlinson
June 27, 2017
Technology
0
130

Interactive big data analysis with Jupyter, Dask and more

JASMIN conf 2017.

Avatar for Jacob Tomlinson

Jacob Tomlinson

June 27, 2017
Tweet

More Decks by Jacob Tomlinson

See All by Jacob Tomlinson
EffVer - Version your code by the effort required to upgrade
Avatar for Jacob Tomlinson jacobtomlinson
0
60
Tech Exeter - Intro to Kubernetes 10 Year Update
Avatar for Jacob Tomlinson jacobtomlinson
0
64
Who Builds the PyData Ecosystem?
Avatar for Jacob Tomlinson jacobtomlinson
0
110
The Art of Wrangling Your GPU Python Environments
Avatar for Jacob Tomlinson jacobtomlinson
0
93
Getting science done with accelerated Python computing platforms
Avatar for Jacob Tomlinson jacobtomlinson
2
150
Dask on HPC in 2024 - Lightning Talk
Avatar for Jacob Tomlinson jacobtomlinson
0
98
GPU Acceleration in the PyData community
Avatar for Jacob Tomlinson jacobtomlinson
0
100
Dask on HPC in 2024
Avatar for Jacob Tomlinson jacobtomlinson
0
120
GPU Acceleration in the PyData community
Avatar for Jacob Tomlinson jacobtomlinson
0
84

Other Decks in Technology

See All in Technology
詳解 強化学習 / In-depth Guide to Reinforcement Learning
Avatar for PRIN Lab prinlab
0
360
建設DXを支えるANDPAD: 2025年のセキュリティの取り組みと卒業したいセキュリティ
Avatar for ANDPAD inc andpad
0
160
Zero Data Loss Autonomous Recovery Service サービス概要
Avatar for oracle4engineer oracle4engineer
PRO
4
13k
Phase07_実務適用
Avatar for overflow ,Inc overflowinc
0
1.6k
【社内勉強会】新年度からコーディングエージェントを使いこなす - 構造と制約で引き出すClaude Codeの実践知
Avatar for nwiizo nwiizo
20
10k
ABEMAのバグバウンティの取り組み
Avatar for Kurochan kurochan
1
600
Tebiki Engineering Team Deck
Avatar for Tebiki, Inc. tebiki
0
27k
俺の/私の最強アーキテクチャ決定戦開催 ― チームで新しいアーキテクチャに適合していくために / 20260322 Naoki Takahashi
Avatar for SHIFT EVOLVE shift_evolve
PRO
1
420
契約書からの情報抽出を行うLLMのスループットを、バッチ処理を用いて最大40%改善した話
Avatar for SansanTech sansantech
PRO
1
160
データマネジメント戦略Night - 4社のリアルを語る会
Avatar for Tatsuya Koreeda ktatsuya
1
170
Phase09_自動化_仕組み化
Avatar for overflow ,Inc overflowinc
0
1.5k
新規事業×QAの挑戦：不確実性を乗りこなす！フェーズごとに求められるQAの役割変革
Avatar for hacomono Inc. hacomono
PRO
0
170

Featured

See All Featured
The SEO Collaboration Effect
Avatar for Kristina Bergwall kristinabergwall1
0
400
How to make the Groovebox
Avatar for あそなす asonas
2
2k
The World Runs on Bad Software
Avatar for Brandon Keepers bkeepers
PRO
72
12k
Marketing Yourself as an Engineer | Alaka | Gurzu
Avatar for Gurzu gurzu
0
160
Designing for Performance
Avatar for Lara Hogan lara
611
70k
Agile Leadership in an Agile Organization
Avatar for Dr. Kim W Petersen kimpetersen
PRO
0
120
Building a Scalable Design System with Sketch
Avatar for Laura Van Doore lauravandoore
463
34k
Lightning talk: Run Django tests with GitHub Actions
Avatar for Sarah Abderemane sabderemane
0
150
Hiding What from Whom? A Critical Review of the History of Programming languages for Music
Avatar for Tomoya Matsuura tomoyanonymous
2
580
We Analyzed 250 Million AI Search Results: Here's What I Found
Avatar for Josh Blyskal joshbly
1
1k
The Mindset for Success: Future Career Progression
Avatar for Greg Gifford greggifford
PRO
0
290
The Pragmatic Product Professional
Avatar for Laura Van Doore lauravandoore
37
7.2k

Transcript

  1. Interactive big data analysis with Jupyter, Dask and more Jacob

    Tomlinson Lead Engineer Met Office Informatics Lab

  2. .@_jacobtomlinson. .linux. .bash. .cloud. .sysadmin. .web development. .docker. .javascript. .git.

    .public speaking. .CI/CD. .automation. .python.
  3. None
  4. None

  5. Processing data at scale

  6. None
  7. None

  8. Iris

  9. None

  10. Laziness

  11. .Currently storing 40PB. .Archiving 200TB per day. .Will store 300PB

    by 2020. *Approx figures - early 2017
  12. None
  13. None

  14. The tools

  15. None
  16. None
  17. None
  18. None

  19. Iris

  20. None
  21. None
  22. None
  23. None
  24. None
  25. None
  26. None
  27. None
  28. None

  29. Summary

  30. Thank you Jacob Tomlinson www.informaticslab.co.uk @_jacobtomlinson