Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Interactive big data analysis with Jupyter, Das...

Avatar for Jacob Tomlinson Jacob Tomlinson
June 27, 2017
Technology
140
0

Interactive big data analysis with Jupyter, Dask and more

JASMIN conf 2017.

Avatar for Jacob Tomlinson

Jacob Tomlinson

June 27, 2017

More Decks by Jacob Tomlinson

See All by Jacob Tomlinson
Documenting your open source projects for machines
Avatar for Jacob Tomlinson jacobtomlinson
0
38
EffVer - Version your code by the effort required to upgrade
Avatar for Jacob Tomlinson jacobtomlinson
0
120
Tech Exeter - Intro to Kubernetes 10 Year Update
Avatar for Jacob Tomlinson jacobtomlinson
0
110
Who Builds the PyData Ecosystem?
Avatar for Jacob Tomlinson jacobtomlinson
0
150
The Art of Wrangling Your GPU Python Environments
Avatar for Jacob Tomlinson jacobtomlinson
0
140
Getting science done with accelerated Python computing platforms
Avatar for Jacob Tomlinson jacobtomlinson
2
430
Dask on HPC in 2024 - Lightning Talk
Avatar for Jacob Tomlinson jacobtomlinson
0
130
GPU Acceleration in the PyData community
Avatar for Jacob Tomlinson jacobtomlinson
0
130
Dask on HPC in 2024
Avatar for Jacob Tomlinson jacobtomlinson
0
160

Other Decks in Technology

See All in Technology
20260804_Q4AzureUpdateBite_FabricDataAgentの精度を高める設計.pdf
Avatar for matayuuu matayuuu
1
140
ガバメント AI 源内を地方自治体は活用できるのか 可能性と課題、期待について
Avatar for takeda_h takeda_h
2
420
Goでデータパイプラインを作ろう
Avatar for SansanTech sansantech
PRO
1
470
Data Hubグループ 紹介資料
Avatar for Sansan, Inc. sansan33
PRO
0
3.2k
Invisible to AI? Making TYPO3 Sites Quotable by AI Search Systems
Avatar for Wolfgang Wagner wolfgangwagner
0
210
まちスペース®とデジタルツインと「まちづくり」
Avatar for hiro_OGI hiro_ogi
0
120
Sansan Engineering Unit 紹介資料
Avatar for Sansan, Inc. sansan33
PRO
1
4.9k
DatadogのBits Chatが開発組織にもたらしたもの / What Bits Chat Has Brought Us
Avatar for SMS tech sms_tech
1
270
JavaScript 研修 (2026)
Avatar for Recruit recruitengineers
PRO
2
570
Kiro Crew入門 - 常駐エージェントの仕組みと使いどころ / Intro to Kiro Crew
Avatar for Kazuki Adachi k_adachi_01
1
150
変化の早いClaude Codeを 書籍に落とし込む
Avatar for Oikon oikon48
7
1.4k
AI-DLC実践録_フルサイクル開発への挑戦
Avatar for Miyuki miyuc
0
150

Featured

See All Featured
Cheating the UX When There Is Nothing More to Optimize - PixelPioneers
Avatar for Stéphanie Walter stephaniewalter
287
14k
Bioeconomy Workshop: Dr. Julius Ecuru, Opportunities for a Bioeconomy in West Africa
Avatar for AKADEMIYA2063 akademiya2063
PRO
1
230
A Guide to Academic Writing Using Generative AI - A Workshop
Avatar for Kenji Saito ks91
PRO
1
370
My Coaching Mixtape
Avatar for mlcsv mlcsv
0
230
Efficient Content Optimization with Google Search Console & Apps Script
Avatar for Katarina Dahlin katarinadahlin
PRO
1
790
Google's AI Overviews - The New Search
Avatar for Barry Adams badams
0
1.1k
Let's Do A Bunch of Simple Stuff to Make Websites Faster
Avatar for Chris Coyier chriscoyier
508
140k
Marketing to machines
Avatar for Jono Alderson jonoalderson
1
5.7k
More Than Pixels: Becoming A User Experience Designer
Avatar for Michelle Schulp Hunt marktimemedia
3
490
Building the Perfect Custom Keyboard
Avatar for Naoto Takai takai
2
840
Design of three-dimensional binary manipulators for pick-and-place task avoiding obstacles (IECON2024)
Avatar for konakalab konakalab
0
540
How To Stay Up To Date on Web Technology
Avatar for Chris Coyier chriscoyier
790
250k

Transcript

  1. Interactive big data analysis with Jupyter, Dask and more Jacob

    Tomlinson Lead Engineer Met Office Informatics Lab

  2. .@_jacobtomlinson. .linux. .bash. .cloud. .sysadmin. .web development. .docker. .javascript. .git.

    .public speaking. .CI/CD. .automation. .python.
  3. None
  4. None

  5. Processing data at scale

  6. None
  7. None

  8. Iris

  9. None

  10. Laziness

  11. .Currently storing 40PB. .Archiving 200TB per day. .Will store 300PB

    by 2020. *Approx figures - early 2017
  12. None
  13. None

  14. The tools

  15. None
  16. None
  17. None
  18. None

  19. Iris

  20. None
  21. None
  22. None
  23. None
  24. None
  25. None
  26. None
  27. None
  28. None

  29. Summary

  30. Thank you Jacob Tomlinson www.informaticslab.co.uk @_jacobtomlinson