1

ImportingdatafromMySQLtoHDFSusingSqoop

a) MySQLInstallationonWindows1. DownloadMySQLInstallerandunzipit.

http://dev.mysql.com/downloads/mysql/

2

2. DoubleclickontheextractedfileandclickonInstallMysqlProducts.

3

3. ClickNext

4

4. Clicknext.

5

5. ClickExecute.

6

6. ClickNext

7

7. ClickExecute.

8

8. ClickNext.

9

9. ClickNext.

10

10. ClickNext.

11

11. Setpasswordforrootuserandclicknext.

12

12. ClickNext.

13

13. ClickNext.

14

14. ClickNext.

15

15. ClickNext.

16

16. OpenMysqlCommandLineClient,givepasswordandmysqlcommandlinewillopen.Nowwecancreatetables,databasesetc.

17

17. Createanewdatabaseandusenewdatabaseusingcommandgivenbelow.

createdatabaseDeZyre;

useDeZyre;

18. Createatableandinsertrecordsasgivenbelow.

CREATETABLEplayer(

player_idINTNOTNULLAUTO_INCREMENT,

player_nameVARCHAR(100)NOTNULL,

PRIMARYKEY(player_id)

);

insertintoplayer(player_name)values("Sachin"),("Dravid"),("Dhoni"),("Ganguly"),("Yuvraj"),("Nehra"),("Singh");

18

19

19. Use“ipconfig”commandtofindoutIPofmysqlserver.

20

ImportingDatafromMySQLtoHDFS

20. FindoutIPoftheserverwhereyouwanttoruntheSqoop.GrantprivilegetothatserveronMySQLserver.Let’ssayIPoftheserverwhereSqoopwillberunningis'192.168.138.128'.TograntprivilegeasshownaboveopenMySQLclientandrunfollowingcommand.TogetIPofVMmachine,FirecommandIfconfig

grantallprivilegeson*.*to'root'@'192.168.2.164'IDENTIFIEDBY'password'WITHGRANTOPTION

21

21. ForimportingdatafromSQLtoHDFSusebelowcommandonClouderaVM.

sqoopimport--connectjdbc:mysql://192.168.138.1/dezyre--tableplayer--usernameroot-P--target-dir/user/cloudera/sqoopOut1-m1

22

22. Onceabovecommandiscompleteyoucanseedatain/user/cloudera/sqoopOut1directory.

ExportdatafromHDFStoMySQL

23. Runfollowingcommandforcreatinganewdirectoryandcreatingdata.

hadoopdfs-mkdir/user/cloudera/sqoopOut2/

viplayer.csv

hadoopdfs-putplayer.csv/user/cloudera/sqoopOut2/

hadoopdfs-cat/user/cloudera/sqoopOut2/player.csv

23

24. Runfollowingcommandforexportingdata.

sqoopexport--connectjdbc:mysql://192.168.138.1/dezyre--tableplayer--usernameroot-P--export-dir/user/cloudera/sqoopOut2/-m1

24

25. SeefromMySQLclientifdataexported.

ImportDatatoHive

sqoopimport--connectjdbc:mysql://192.168.2.1/dezyre--usernameroot--passwordpassword--tableplayer--hive-import