Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Interactive big data analysis with Jupyter, Das...

Jacob Tomlinson
June 27, 2017
Technology
0
130

Interactive big data analysis with Jupyter, Dask and more

JASMIN conf 2017.

Jacob Tomlinson

June 27, 2017
Tweet

More Decks by Jacob Tomlinson

See All by Jacob Tomlinson
Who Builds the PyData Ecosystem?
jacobtomlinson
0
2
The Art of Wrangling Your GPU Python Environments
jacobtomlinson
0
6
Getting science done with accelerated Python computing platforms
jacobtomlinson
0
2
Dask on HPC in 2024 - Lightning Talk
jacobtomlinson
0
27
GPU Acceleration in the PyData community
jacobtomlinson
0
23
Dask on HPC in 2024
jacobtomlinson
0
4
GPU Acceleration in the PyData community
jacobtomlinson
0
1
When to rebuild things that already exist
jacobtomlinson
0
6
Accelerating Python on HPC with Dask and RAPIDS
jacobtomlinson
0
3

Other Decks in Technology

See All in Technology
7日間でハッキングをはじめる本をはじめてみませんか？_ITエンジニア本大賞2025
nomizone
2
1.4k
2.5Dモデルのすべて
yu4u
2
610
AWSでRAGを実現する上で感じた3つの大事なこと
ymae
3
1k
AndroidXR 開発ツールごとの できることできないこと
donabe3
0
110
【Developers Summit 2025】プロダクトエンジニアから学ぶ、 ユーザーにより高い価値を届ける技術
niwatakeru
2
890
関東Kaggler会LT: 人狼コンペとLLM量子化について
nejumi
3
460
モノレポ開発のエラー、誰が見る？Datadog で実現する適切なトリアージとエスカレーション
biwashi
6
770
5分で紹介する生成AIエージェントとAmazon Bedrock Agents / 5-minutes introduction to generative AI agents and Amazon Bedrock Agents
hideakiaoyagi
0
220
現場で役立つAPIデザイン
nagix
29
10k
技術的負債解消の取り組みと専門チームのお話 #技術的負債_Findy
bengo4com
1
1.2k
CZII - CryoET Object Identification 参加振り返り・解法共有
tattaka
0
240
君はPostScriptなウィンドウシステム 「NeWS」をご存知か?/sunnews
koyhoge
0
720

Featured

See All Featured
4 Signs Your Business is Dying
shpigford
182
22k
Producing Creativity
orderedlist
PRO
343
39k
The Language of Interfaces
destraynor
156
24k
Templates, Plugins, & Blocks: Oh My! Creating the theme that thinks of everything
marktimemedia
29
2.2k
Cheating the UX When There Is Nothing More to Optimize - PixelPioneers
stephaniewalter
280
13k
A designer walks into a library…
pauljervisheath
205
24k
RailsConf 2023
tenderlove
29
1k
Navigating Team Friction
lara
183
15k
The Psychology of Web Performance [Beyond Tellerrand 2023]
tammyeverts
45
2.3k
RailsConf & Balkan Ruby 2019: The Past, Present, and Future of Rails at GitHub
eileencodes
132
33k
The Web Performance Landscape in 2024 [PerfNow 2024]
tammyeverts
4
400
The Pragmatic Product Professional
lauravandoore
32
6.4k

Transcript

  1. Interactive big data analysis with Jupyter, Dask and more Jacob

    Tomlinson Lead Engineer Met Office Informatics Lab

  2. .@_jacobtomlinson. .linux. .bash. .cloud. .sysadmin. .web development. .docker. .javascript. .git.

    .public speaking. .CI/CD. .automation. .python.
  3. None
  4. None

  5. Processing data at scale

  6. None
  7. None

  8. Iris

  9. None

  10. Laziness

  11. .Currently storing 40PB. .Archiving 200TB per day. .Will store 300PB

    by 2020. *Approx figures - early 2017
  12. None
  13. None

  14. The tools

  15. None
  16. None
  17. None
  18. None

  19. Iris

  20. None
  21. None
  22. None
  23. None
  24. None
  25. None
  26. None
  27. None
  28. None

  29. Summary

  30. Thank you Jacob Tomlinson www.informaticslab.co.uk @_jacobtomlinson