Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Data Breaking Bad

Avatar for Michael Hausenblas Michael Hausenblas
June 03, 2013
Technology
1
200

Data Breaking Bad

Open Stage talk at Berlin Buzzwords 2013

Avatar for Michael Hausenblas

Michael Hausenblas

June 03, 2013
Tweet

More Decks by Michael Hausenblas

See All by Michael Hausenblas
KubeCologne keynote—Troubleshooting Kubernetes apps
Avatar for Michael Hausenblas mhausenblas
4
8.1k
Extending Kubernetes 101
Avatar for Michael Hausenblas mhausenblas
4
2.3k
Kubernetes and serverless technologies for high-performance applications
Avatar for Michael Hausenblas mhausenblas
1
360
Troubleshooting Kubernetes Applications
Avatar for Michael Hausenblas mhausenblas
1
610
Autoscaling All Things Kubernetes with Prometheus
Avatar for Michael Hausenblas mhausenblas
0
960
Three Billy Goats Gruff
: from a monolith to containers to functions
Avatar for Michael Hausenblas mhausenblas
0
590
Bending Kubernetes to Your Needs
Avatar for Michael Hausenblas mhausenblas
2
2.8k
Kubernetes Security: from Image Hygiene to Network Policies
Avatar for Michael Hausenblas mhausenblas
8
4k
Hands-on Cloud Native Lifecycle Management
Avatar for Michael Hausenblas mhausenblas
3
440

Other Decks in Technology

See All in Technology
serverless team topology
Avatar for kensh _kensh
3
260
ゼロコード計装導入後のカスタム計装でさらに可観測性を高めよう
Avatar for SansanTech sansantech
PRO
1
610
累計5000万DLサービスの裏側 – LINEマンガのKotlinで挑む大規模 Server-side ETLの最適化
Avatar for LINE Digital Frontier - TECH ldf_tech
0
110
AWS DMS で SQL Server を移行してみた/aws-dms-sql-server-migration
Avatar for emi emiki
0
270
ヘンリー会社紹介資料（エンジニア向け） / company deck for engineer
Avatar for Henry, Inc. henryofficial
0
440
「タコピーの原罪」から学ぶ間違った”支援” / the bad support of Takopii
Avatar for piyonakajima piyonakajima
0
160
ざっくり学ぶ 『エンジニアリングリーダー 技術組織を育てるリーダーシップと セルフマネジメント』 / 50 minute Engineering Leader
Avatar for iwashi iwashi86
8
4k
Kotlinで型安全にバイテンポラルデータを扱いたい！ ReladomoラッパーをAIと実装してみた話
Avatar for Hiroshi Ito itohiro73
3
130
.NET 10のBlazorの期待の新機能
Avatar for tkym htkym
0
170
AIの個性を理解し、指揮する
Avatar for shoota shoota
3
590
データエンジニアとして生存するために 〜界隈を盛り上げる「お祭り」が必要な理由〜 / data_summit_findy_Session_1
Avatar for Sansan R&D sansan_randd
0
330
DSPy入門
Avatar for TomuHirata tomehirata
6
830

Featured

See All Featured
Improving Core Web Vitals using Speculation Rules API
Avatar for Sergey Chernyshev sergeychernyshev
21
1.2k
KATA
Avatar for Megan Lloyd mclloyd
PRO
32
15k
Intergalactic Javascript Robots from Outer Space
Avatar for Vicent Martí tanoku
273
27k
Measuring & Analyzing Core Web Vitals
Avatar for Philip Tellis bluesmoon
9
650
Gamification - CAS2011
Avatar for David Bonilla davidbonilla
81
5.5k
Statistics for Hackers
Avatar for Jake VanderPlas jakevdp
799
220k
"I'm Feeling Lucky" - Building Great Search Experiences for Today's Users (#IAC19)
Avatar for Dan Newman danielanewman
230
22k
The Art of Programming - Codeland 2020
Avatar for Erika Heidi erikaheidi
56
14k
It's Worth the Effort
Avatar for 3n 3n
187
28k
Fantastic passwords and where to find them - at NoRuKo
Avatar for Phil Nash philnash
52
3.5k
How to Create Impact in a Changing Tech Landscape [PerfNow 2023]
Avatar for Tammy Everts tammyeverts
55
3k
How to train your dragon (web standard)
Avatar for Monica Dinculescu notwaldorf
97
6.3k

Transcript

  1. Da Michael Hausenblas, MapR Technologies Berlin Buzzwords 2013, Open Stage

    Talk Friday, 7 June 13

  2. Nope. Not this one. Friday, 7 June 13

  3. Friday, 7 June 13

  4. things you can influence things that affect you try and

    focus on this stuff Friday, 7 June 13

  5. The awkward moment when I open the data I got

    from a customer Friday, 7 June 13

  6. http://techcrunch.com/2012/11/25/the-big-data-fallacy-data-%E2%89%A0-information-%E2%89%A0-insights/ aka crap in, crap out Friday, 7 June 13

  7. Some examples … Friday, 7 June 13

  8. • Encöding hell • Schema? Sure, I fax you a

    screenshot • Dupes and other fakes • Sampling Friday, 7 June 13

  9. Encöding hell application-specific encodings • URL encoding • HTML encoding

    • Database escaping non-ASCII? a%20percent-encoded%20string%20as%20of%20RFC%203986 a <strong>HTML</strong> encoded string Friday, 7 June 13

  10. • Use Unicode • Use Unicode • Use Unicode Encöding

    hell http://www.swedishfika.com/2010/01/19/escaping-from-encoding-hell/ Friday, 7 June 13

  11. • Encöding hell • Schema? Sure, I fax you a

    screenshot • Dupes and other fakes • Sampling Friday, 7 June 13

  12. Schema? Sure, I fax you a screenshot Friday, 7 June

    13

  13. Schema? Sure, I fax you a screenshot • There is

    a need for proper, formal documentation • For humans and machines • Basis for validation—automate! Friday, 7 June 13

  14. • Encöding hell • Schema? Sure, I fax you a

    screenshot • Dupes and other fakes • Sampling Friday, 7 June 13

  15. Dupes and other fakes Friday, 7 June 13

  16. Dupes and other fakes Friday, 7 June 13

  17. Dupes and other fakes • Use plots to get an

    overview • Watch out for outliers • Try to establish source for errors and fix • Document (in any case) Friday, 7 June 13

  18. • Encöding hell • Schema? Sure, I fax you a

    screenshot • Dupes and other fakes • Sampling Friday, 7 June 13

  19. • My data is too big. I can’t check it

    all. • Why don’t you sample, then? Sampling Friday, 7 June 13

  20. http://mortardata.com/ Friday, 7 June 13

  21. Friday, 7 June 13

  22. Go and buy this book. Now. Friday, 7 June 13