Upgrade to Pro — share decks privately, control downloads, hide ads and more …

The Transporter 4 MySQL

Avatar for Sagar Nikam Sagar Nikam
July 11, 2013
Programming
0
60

The Transporter 4 MySQL

import & export to HDFS, Hive, HBase, csv, sql, text, tsv, xml

Avatar for Sagar Nikam

Sagar Nikam

July 11, 2013
Tweet

More Decks by Sagar Nikam

See All by Sagar Nikam
Who Changed my Password ?
Avatar for Sagar Nikam sagarnikam123
1
66
Small Wonders of BioAccumulators
Avatar for Sagar Nikam sagarnikam123
2
86
BIM_2010_20-Project Presentation
Avatar for Sagar Nikam sagarnikam123
2
46
Toxicology of Modern Medicine
Avatar for Sagar Nikam sagarnikam123
1
55

Other Decks in Programming

See All in Programming
バイブコーディングの正体——AIエージェントはソフトウェア開発を変えるか？
Avatar for Shinichi Takayanagi stakaya
3
290
Claude Code派？Gemini CLI派？ みんなで比較LT会！_20250716
Avatar for じゅん junholee
1
760
Flutterと Vibe Coding で個人開発！
Avatar for Hayami Shuhei hyshu
0
140
それ CLI フレームワークがなくてもできるよ / Building CLI Tools Without Frameworks
Avatar for Kuniwak orgachem
PRO
15
3.4k
コーディングエージェント概観(2025/07)
Avatar for Itsuki itsuki_t88
0
460
可変性を制する設計: 構造と振る舞いから考える概念モデリングとその実装
Avatar for Akira Suenami a_suenami
8
1.1k
PHPUnitの限界をPlaywrightで補完するテストアプローチ
Avatar for yuzneri yuzneri
0
360
脱Riverpod？fqueryで考える、TanStack Queryライクなアーキテクチャの可能性
Avatar for Takuma Osada ostk0069
0
570
DMMを支える決済基盤の技術的負債にどう立ち向かうか / Addressing Technical Debt in Payment Infrastructure
Avatar for yoshiyoshifujii yoshiyoshifujii
4
670
PHPカンファレンス関西2025　基調講演
Avatar for SUGIMOTO Kei sugimotokei
6
1k
CIを整備してメンテナンスを生成AIに任せる
Avatar for Hazumi Ichijo hazumirr
0
370
DataformでPythonする / dataform-de-python
Avatar for snhryt snhryt
0
110

Featured

See All Featured
A better future with KSS
Avatar for Kyle Neath kneath
238
17k
Imperfection Machines: The Place of Print at Facebook
Avatar for Scott Boms scottboms
267
13k
The Success of Rails: Ensuring Growth for the Next 100 Years
Avatar for Eileen M. Uchitelle eileencodes
45
7.5k
Scaling GitHub
Avatar for Zach Holman holman
461
140k
Learning to Love Humans: Emotional Interface Design
Avatar for Aarron Walter aarron
273
40k
RailsConf & Balkan Ruby 2019: The Past, Present, and Future of Rails at GitHub
Avatar for Eileen M. Uchitelle eileencodes
139
34k
Why Our Code Smells
Avatar for Brandon Keepers bkeepers
PRO
337
57k
Producing Creativity
Avatar for Steve Smith orderedlist
PRO
346
40k
4 Signs Your Business is Dying
Avatar for Josh Pigford shpigford
184
22k
How GitHub (no longer) Works
Avatar for Zach Holman holman
314
140k
Build your cross-platform service in a week with App Engine
Avatar for Jose L jlugia
231
18k
Understanding Cognitive Biases in Performance Measurement
Avatar for Philip Tellis bluesmoon
29
1.8k

Transcript

  1. The Transporter 4 MySQL A visual Guide 4 Importing &

    Exporting csv, xml, tsv, text, sql, MySql, HDFS, Hive, HBase

  2. contents • Export 2 csv • Import csv • Exporting

    2 sql • Importing sql • Exporting 2 xml • Importing xml • Exporting 2 tsv • Exporting 2 text • Exporting 2 HDFS • Installing Apache Sqoop • exporting 2 HDFS • Importing 2 MySQL • Exporting 2 Hive • Exporting 2 HBase

  3. open MySQL

  4. exporting to CSV

  5. exporting CSV – Problem ?

  6. check Appamor status

  7. AA Status

  8. AA

  9. go to apparmor.d

  10. edit usr.sbin.mysqld

  11. usr.sbin.mysqld

  12. after editing usr.sbin.mysqld

  13. make /tmp/data directory

  14. make /data directory

  15. mounting

  16. reload apparmor

  17. restarting apparmor . . .

  18. exporting .csv

  19. Importing csv

  20. importing .csv – problem ?

  21. importing .csv

  22. edit my.cnf

  23. my.cnf file

  24. after editing my.cnf

  25. importing .csv

  26. exporting sql

  27. view tables

  28. create country table

  29. inserting data into country table

  30. exporting .sql

  31. exported .sql file

  32. Importing sql

  33. importing .sql

  34. exporting xml

  35. exporting .xml

  36. importing xml

  37. importing xml

  38. exporting tsv

  39. exporting .tsv

  40. exported .tsv file

  41. exporting txt

  42. exporting .txt

  43. exported .txt file

  44. exporting to HDFS

  45. installing Apache Sqoop

  46. Apache Sqoop Home Page

  47. Sqoop folder structure

  48. add mysqlJ connector in SqoopHome/lib

  49. export & check version

  50. sqoop help

  51. list databases

  52. make dir in HDFS

  53. check mysql tables

  54. grant permissions

  55. exporting 2 HDFS

  56. exporting completes

  57. Intermediate .java file (mapReduce)

  58. HDFS table

  59. exporting to HDFS

  60. exporting to HDFS

  61. importing to MySQL (4m HDFS)

  62. HDFS table

  63. make MySQL table structure

  64. importing to MySQL

  65. importing completes

  66. imported table

  67. exporting to Hive

  68. check Hive for redundant table

  69. exporting 2 Hive

  70. libthrift version error

  71. export fake HBase_Home

  72. check Hive tables

  73. export to HBase

  74. mysql table

  75. employee table

  76. start HBase daemons

  77. exporting to HBase

  78. exporting completes

  79. all Sqoop queries

  80. finish