Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Interactive big data analysis with Jupyter, Das...

Jacob Tomlinson
June 27, 2017
Technology
0
130

Interactive big data analysis with Jupyter, Dask and more

JASMIN conf 2017.

Jacob Tomlinson

June 27, 2017
Tweet

More Decks by Jacob Tomlinson

See All by Jacob Tomlinson
Dask on HPC in 2024 - Lightning Talk
jacobtomlinson
0
15
GPU Acceleration in the PyData community
jacobtomlinson
0
9
Dask Demo Day - How RAPIDS users use Dask
jacobtomlinson
0
21
Deploying multi-GPU workloads on Kubernetes in Python
jacobtomlinson
0
190
Overview of Dask on Kubernetes
jacobtomlinson
0
140
k8s-batch-sig - Dask on Kubernetes
jacobtomlinson
0
110
Deploying multi-GPU workloads on Kubernetes in Python
jacobtomlinson
0
140
Dask Overview - Stanford Legion all-hands
jacobtomlinson
0
190
Container Canary - Lightning Talk
jacobtomlinson
0
62

Other Decks in Technology

See All in Technology
適材適所の技術選定 〜GraphQL・REST API・tRPC〜 / Optimal Technology Selection
kakehashi
1
460
[CV勉強会@関東 ECCV2024 読み会] オンラインマッピング x トラッキング MapTracker: Tracking with Strided Memory Fusion for Consistent Vector HD Mapping (Chen+, ECCV24)
abemii
0
220
Lexical Analysis
shigashiyama
1
150
データプロダクトの定義からはじめる、データコントラクト駆動なデータ基盤
chanyou0311
2
310
Adopting Jetpack Compose in Your Existing Project - GDG DevFest Bangkok 2024
akexorcist
0
110
ExaDB-D dbaascli で出来ること
oracle4engineer
PRO
0
3.8k
SRE×AIOpsを始めよう！GuardDutyによるお手軽脅威検出
amixedcolor
0
110
SSMRunbook作成の勘所_20241120
koichiotomo
2
140
社内で最大の技術的負債のリファクタリングに取り組んだお話し
kidooonn
1
550
OCI Vault 概要
oracle4engineer
PRO
0
9.7k
ノーコードデータ分析ツールで体験する時系列データ分析超入門
negi111111
0
410
TypeScript、上達の瞬間
sadnessojisan
46
13k

Featured

See All Featured
Bash Introduction
62gerente
608
210k
Scaling GitHub
holman
458
140k
Teambox: Starting and Learning
jrom
133
8.8k
What’s in a name? Adding method to the madness
productmarketing
PRO
22
3.1k
Adopting Sorbet at Scale
ufuk
73
9.1k
RailsConf 2023
tenderlove
29
900
Designing for humans not robots
tammielis
250
25k
A Modern Web Designer's Workflow
chriscoyier
693
190k
実際に使うSQLの書き方 徹底解説 / pgcon21j-tutorial
soudai
169
50k
The Power of CSS Pseudo Elements
geoffreycrofte
73
5.3k
Become a Pro
speakerdeck
PRO
25
5k
What's in a price? How to price your products and services
michaelherold
243
12k

Transcript

  1. Interactive big data analysis with Jupyter, Dask and more Jacob

    Tomlinson Lead Engineer Met Office Informatics Lab

  2. .@_jacobtomlinson. .linux. .bash. .cloud. .sysadmin. .web development. .docker. .javascript. .git.

    .public speaking. .CI/CD. .automation. .python.
  3. None
  4. None

  5. Processing data at scale

  6. None
  7. None

  8. Iris

  9. None

  10. Laziness

  11. .Currently storing 40PB. .Archiving 200TB per day. .Will store 300PB

    by 2020. *Approx figures - early 2017
  12. None
  13. None

  14. The tools

  15. None
  16. None
  17. None
  18. None

  19. Iris

  20. None
  21. None
  22. None
  23. None
  24. None
  25. None
  26. None
  27. None
  28. None

  29. Summary

  30. Thank you Jacob Tomlinson www.informaticslab.co.uk @_jacobtomlinson