Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Hadoop, and what Hadoop can do for us?
Search
andre
September 23, 2011
Programming
0
110
Hadoop, and what Hadoop can do for us?
It's a brief intro for Hadoop. Although it's spark's world now.
andre
September 23, 2011
Tweet
Share
More Decks by andre
See All by andre
Booking.com Hackathon Taipei 2017
andre
0
180
Auto I18N (Internationalization) Process
andre
0
65
Write Securer Code
andre
0
57
iPatrol
andre
0
54
Hello SDN
andre
0
100
koa introduction (Node.js Web Framework)
andre
3
360
RxJS (The Reactive Extensions for JavaScript ) Introduction
andre
4
350
JSDC 2014 Taiwan Lightning Talk: TBD
andre
0
120
From Facebook Graph API 1.0 to 2.1
andre
0
220
Other Decks in Programming
See All in Programming
Folding Cheat Sheet #2
philipschwarz
PRO
0
110
What We Can Learn From OSS
inouehi
0
390
OpenTelemetry のサービスという概念について
azukiazusa1
2
1.1k
Git Rebase
bkuhlmann
11
1.6k
FigmaとPHPで作る1ミリたりとも表示崩れしない最強の帳票印刷ソリューション
ttskch
39
17k
Blue/Greenデプロイの導入による 運用フローの改善
kudoas
1
350
1BRC--Nerd Sniping the Java Community
gunnarmorling
0
300
PHP8.3の機能を振り返る / Review of PHP 8.3 features
seike460
PRO
1
110
せっかくモデル図描くのなら、嬉しいことが多い方がいいよね!
kuboaki
1
3.1k
PHPの次期バージョンはこの時期どうなっているのか - Internalsの開発体制について - PHPカンファレンス小田原
youkidearitai
PRO
1
180
コードレビューで学ぶ!Kotlinオブジェクト指向デザインパターン
akkie76
2
170
二郎系ラーメンのコールで学ぶ AST 解析
memory1994
PRO
7
1.6k
Featured
See All Featured
Building a Modern Day E-commerce SEO Strategy
aleyda
16
6.3k
Designing the Hi-DPI Web
ddemaree
276
33k
Debugging Ruby Performance
tmm1
69
11k
Rebuilding a faster, lazier Slack
samanthasiow
72
8.2k
A Modern Web Designer's Workflow
chriscoyier
689
190k
StorybookのUI Testing Handbookを読んだ
zakiyama
10
4.5k
The Psychology of Web Performance [Beyond Tellerrand 2023]
tammyeverts
5
1.5k
Being A Developer After 40
akosma
56
580k
Imperfection Machines: The Place of Print at Facebook
scottboms
258
12k
Bootstrapping a Software Product
garrettdimon
PRO
301
110k
Scaling GitHub
holman
457
140k
What the flash - Photography Introduction
edds
64
11k
Transcript
S Hadoop, and what Hadoop can do for us?
How to get the info you want from totally 10TB
log files? S After 1 hour S After 2 hours S After 3 hours S … S After 2 days
Hadoop S is a Java-based framework S contains S Hadoop
Common S Hadoop HDFS S Hadoop MapReduce S and has lots of children and friends
How it works? DEBUG - 2011-09-22 13:56:15 --> Session Class
Initialized : OBSession 2.0.0 DEBUG - 2011-09-22 13:56:15 --> Database Driver Class Initialized DEBUG - 2011-09-22 13:56:15 --> A session cookie was not found. DEBUG - 2011-09-22 13:56:16 --> Sending session cookie DEBUG - 2011-09-22 13:56:16 --> New session started. DEBUG - 2011-09-22 13:56:16 --> Controller Class Initialized DEBUG - 2011-09-22 13:56:16 --> [MYLanguage] Language file loaded: language/EN-US/portal_lang.xml ERROR - 2011-09-22 13:56:16 --> [MYConfig] MY Config class in framework loaded DEBUG - 2011-09-22 13:56:16 --> Config Class Initialized ERROR - 2011-09-22 13:56:16 --> Hooks Class Initialized Reducer DEBUG 8 ERROR 2
What are the difficult parts? S Mapper & Reducer S
Mapper & Reducer S Mapper & Reducer S Mapper & Reducer S Mapper & Reducer
and next? S Search & index
CloudGo!