Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Sign up for free
Menu
Search
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Pricing
Search
Sign in
Sign up for free
The Transporter 4 MySQL
Search
Sagar Nikam
July 11, 2013
Programming
79
0
Share
Embed
Copy iframe code
Copy JS code
Copy link
Start on current slide
The Transporter 4 MySQL
import & export to HDFS, Hive, HBase, csv, sql, text, tsv, xml
Sagar Nikam
July 11, 2013
Transcript
80 slides
The Transporter 4 MySQL A visual Guide 4 Importing &
Exporting csv, xml, tsv, text, sql, MySql, HDFS, Hive, HBase
contents • Export 2 csv • Import csv • Exporting
2 sql • Importing sql • Exporting 2 xml • Importing xml • Exporting 2 tsv • Exporting 2 text • Exporting 2 HDFS • Installing Apache Sqoop • exporting 2 HDFS • Importing 2 MySQL • Exporting 2 Hive • Exporting 2 HBase
open MySQL
exporting to CSV
exporting CSV – Problem ?
check Appamor status
AA Status
AA
go to apparmor.d
edit usr.sbin.mysqld
usr.sbin.mysqld
after editing usr.sbin.mysqld
make /tmp/data directory
make /data directory
mounting
reload apparmor
restarting apparmor . . .
exporting .csv
Importing csv
importing .csv – problem ?
importing .csv
edit my.cnf
my.cnf file
after editing my.cnf
importing .csv
exporting sql
view tables
create country table
inserting data into country table
exporting .sql
exported .sql file
Importing sql
importing .sql
exporting xml
exporting .xml
importing xml
importing xml
exporting tsv
exporting .tsv
exported .tsv file
exporting txt
exporting .txt
exported .txt file
exporting to HDFS
installing Apache Sqoop
Apache Sqoop Home Page
Sqoop folder structure
add mysqlJ connector in SqoopHome/lib
export & check version
sqoop help
list databases
make dir in HDFS
check mysql tables
grant permissions
exporting 2 HDFS
exporting completes
Intermediate .java file (mapReduce)
HDFS table
exporting to HDFS
exporting to HDFS
importing to MySQL (4m HDFS)
HDFS table
make MySQL table structure
importing to MySQL
importing completes
imported table
exporting to Hive
check Hive for redundant table
exporting 2 Hive
libthrift version error
export fake HBase_Home
check Hive tables
export to HBase
mysql table
employee table
start HBase daemons
exporting to HBase
exporting completes
all Sqoop queries
finish
More Decks by Sagar Nikam
See All by Sagar Nikam
Who Changed my Password ?
sagarnikam123
1
89
Small Wonders of BioAccumulators
sagarnikam123
2
110
BIM_2010_20-Project Presentation
sagarnikam123
2
67
Toxicology of Modern Medicine
sagarnikam123
1
84
Other Decks in Programming
See All in Programming
Rails初心者がパスキーを実装してみて大変だったこと
ktombow
0
240
マルチプロダクトSaaSの アプリ一覧を速くする——複数プロダクトにまたがる「権限行脚」を減らすまで #techramen26conf
mktakuya
1
190
例外からRich Errorsまで Kotlinエラーハンドリングの進化を読み解く
shiita0903
0
240
Claude Codeのおかげでやりたいことがやれるようになったんだよォー!
sms_tech
0
190
社内AIエージェント「Askワンバン」における コストチューニングの取り組み
t0yohei
0
180
Growing PicoRuby's Ecosystem on ESP32
yuuu
2
150
Kotlin JVM用に作られたライブラリのKMPを前提とした再設計
jsoizo
0
230
The Cost of the DOM
ypresto
2
210
JavaScriptはシングルバイナリの夢を見るか / Does JavaScript Dream of a Single Binary?
ssssota
0
150
Beyond Chatbots: Agentic UI with Open Standards @W-JAX 2026, München
manfredsteyer
PRO
0
130
AIが生成したコードは読むべきか?抽象化設計とコードの品質保証 / abstraction-design-and-quality
minodriven
17
9.5k
読みやすい!と評判(?)の発表の準備にかける私のこだわり
shoheimitani
0
160
Featured
See All Featured
Code Reviewing Like a Champion
maltzj
529
40k
The untapped power of vector embeddings
frankvandijk
2
2k
The Illustrated Guide to Node.js - THAT Conference 2024
reverentgeek
1
620
Principles of Awesome APIs and How to Build Them.
keavy
128
18k
The Hidden Cost of Media on the Web [PixelPalooza 2025]
tammyeverts
2
580
Marketing to machines
jonoalderson
1
6k
RailsConf 2023
tenderlove
30
1.6k
The World Runs on Bad Software
bkeepers
PRO
72
12k
Jess Joyce - The Pitfalls of Following Frameworks
techseoconnect
PRO
1
480
Let's Do A Bunch of Simple Stuff to Make Websites Faster
chriscoyier
508
140k
実際に使うSQLの書き方 徹底解説 / pgcon21j-tutorial
soudai
PRO
203
77k
Designing for humans not robots
tammielis
254
26k