Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Bleu Framework for Hbase & Hadoop
Search
Bleu (Jia-Huei Ren)
January 06, 2015
Design
0
62
Bleu Framework for Hbase & Hadoop
Presentation for Cloud-based applications
Bleu (Jia-Huei Ren)
January 06, 2015
Tweet
Share
More Decks by Bleu (Jia-Huei Ren)
See All by Bleu (Jia-Huei Ren)
Introduction to Convolutional Neural Networks
divjose
0
83
Recently doing-20161110
divjose
0
44
Industry 5.0
divjose
0
230
Big Data
divjose
0
67
Database Management Concepts
divjose
0
63
Paper discuss : Hadoop & HBase
divjose
1
58
Visualizing social network concepts
divjose
0
73
Determinants of RFID adoption intention: Evidence from Taiwanese retail chains
divjose
0
60
Presetation - SALESPOINT: A Java framework for teaching object-oriented software development
divjose
0
130
Other Decks in Design
See All in Design
Ride or Die Animatics
warwatkar
0
140
デザインをみんなのものに 「デザインの脱植民地化」を日本の文脈で考える
mayunak
7
4.1k
UX/UI改善に貢献するユーザーテストとは? 基礎知識から実施のプロセスまで解説
ncdc
0
350
3D空間を扱うUI表現とユーザビリティ
akinen
0
470
実務のための マイクロ インタラクション入門
shingo2000
0
370
Designing UIs without a UI designer
strongeron
0
140
20231122_Design Leader Impact Award_Presentation_FAKE Okazaki
okazakityo
1
260
成果が出ないユーザーインタビューは何がダメだったのか? ~「誰に聞くか」の探り方 ~
jouykw
10
13k
マスとAIをなめらかにつなぐデザイン
abcmisuzu
0
250
ユーザーのためなら 『デザイン』 以外にも手を伸ばせる
navitimejapan
PRO
2
800
顕在化されていない期待、デザインの灯台
daitorii
1
1.1k
PRDがデザインプロセスを高速化した話
tooomo
1
340
Featured
See All Featured
Into the Great Unknown - MozCon
thekraken
15
1k
Automating Front-end Workflow
addyosmani
1357
200k
Building Flexible Design Systems
yeseniaperezcruz
320
37k
5 minutes of I Can Smell Your CMS
philhawksworth
199
19k
Building an army of robots
kneath
300
41k
CSS Pre-Processors: Stylus, Less & Sass
bermonpainter
352
28k
Web development in the modern age
philhawksworth
203
10k
Being A Developer After 40
akosma
67
580k
We Have a Design System, Now What?
morganepeng
43
6.8k
Responsive Adventures: Dirty Tricks From The Dark Corners of Front-End
smashingmag
245
20k
Designing Experiences People Love
moore
136
23k
Unsuck your backbone
ammeep
664
57k
Transcript
Bleu Framework for Hbase & Hadoop 49941131 JIA-HUEI REN
[email protected]
NoSQL, Not Only SQL select fun, profit from real_world where
relational=false;
Behavior • Increase the machine will automatically expand the data
storage. • The schema-less format of a Key-Value. • CAP – Consistent – Availability – Partition Tolerance
Consistent • All nodes see the same data at the
same time.
Availability • A guarantee that every request receives a response
about whether it was successful or failed.
Partition Tolerance • The system continues to operate despite arbitrary
message loss or failure of part of the system.
Why ?
Recording?
Recording?
Analyzing
Visualizing
Database Transfer
Usage • Big Users • Big Data • Internet of
Things • Cloud Computing
So…I make a framework For NoSQL and RDBMS
Bleu Framework • High Compatibility • High Transferability • Low
coupling • High cohesion
What’s MVC
What’s Thrift PHP Hbase Thrift Hadoop
Thrift Struct Exception Function struct TCell struct ColumnDescriptor struct TRegionInfo
struct Mutation struct BatchMutation struct TIncrement struct TColumn struct TRowResult struct TScan exception IOError exception IllegalArgument exception AlreadyExists enableTable() disableTable() bool isTableEnabled() getTableNames() getColumnDescriptors() createTable() deleteTable() get() getRow() getRowWithColumns() getRows() mutateRow() mutateRows() deleteAll() deleteAllRow() scannerOpen() scannerGet() scannerClose()
Create & Drop table Schema::create('users', function($table) { $table->increments('id'); } );
Schema::drop('users');
Get • getTableNames • getTable • getTables
Select User ::all(); User ::find(1);
Insert $user = new User; $user->name = 'John'; $user->save();
Update $user = User::find(1); $user->email = '
[email protected]
'; $user->save();
Delete $user = User::find(1); $user->delete(); User::destroy(array(1, 2, 3));
Performance Comparison 0 50 100 150 200 250 300 350
400 450 500 1000 20000 100000 1000000 2000000 Hadoop MySQL
Conclusions • Use Thrift-PHP will reduce the performance of Hbase.
• This framework can easily switch between NoSQL database and RDBMS. • ORM design gives this framework more readable.
Further works • More database engine support. • Performance •
Flexible
Show Time :)
Thanks!