The Transporter 4 MySQL

import & export to HDFS, Hive, HBase, csv, sql, text, tsv, xml

Transcript

1. The Transporter 4 MySQL A visual Guide 4 Importing & Exporting csv, xml, tsv, text, sql, MySql, HDFS, Hive, HBase
2. contents • Export 2 csv • Import csv • Exporting 2 sql • Importing sql • Exporting 2 xml • Importing xml • Exporting 2 tsv • Exporting 2 text • Exporting 2 HDFS • Installing Apache Sqoop • exporting 2 HDFS • Importing 2 MySQL • Exporting 2 Hive • Exporting 2 HBase
3. open MySQL
4. exporting to CSV
5. exporting CSV – Problem ?
6. check Appamor status
7. AA Status
8. AA
9. go to apparmor.d
10. edit usr.sbin.mysqld
11. usr.sbin.mysqld
12. after editing usr.sbin.mysqld
13. make /tmp/data directory
14. make /data directory
15. mounting
16. reload apparmor
17. restarting apparmor . . .
18. exporting .csv
19. Importing csv
20. importing .csv – problem ?
21. importing .csv
22. edit my.cnf
23. my.cnf file
24. after editing my.cnf
25. importing .csv
26. exporting sql
27. view tables
28. create country table
29. inserting data into country table
30. exporting .sql
31. exported .sql file
32. Importing sql
33. importing .sql
34. exporting xml
35. exporting .xml
36. importing xml
37. importing xml
38. exporting tsv
39. exporting .tsv
40. exported .tsv file
41. exporting txt
42. exporting .txt
43. exported .txt file
44. exporting to HDFS
45. installing Apache Sqoop
46. Apache Sqoop Home Page
47. Sqoop folder structure
48. add mysqlJ connector in SqoopHome/lib
49. export & check version
50. sqoop help
51. list databases
52. make dir in HDFS
53. check mysql tables
54. grant permissions
55. exporting 2 HDFS
56. exporting completes
57. Intermediate .java file (mapReduce)
58. HDFS table
59. exporting to HDFS
60. exporting to HDFS
61. importing to MySQL (4m HDFS)
62. HDFS table
63. make MySQL table structure
64. importing to MySQL
65. importing completes
66. imported table
67. exporting to Hive
68. check Hive for redundant table
69. exporting 2 Hive
70. libthrift version error
71. export fake HBase_Home
72. check Hive tables
73. export to HBase
74. mysql table
75. employee table
76. start HBase daemons
77. exporting to HBase
78. exporting completes
79. all Sqoop queries
80. finish