Scribd Logo
Upload

Welcome to Scribd!

  • 02 Sqoop

    Uploaded by

    helmi.sassi.hs
    3 views2 pages
    This document provides 3 examples of using SQOOP to import data from a MySQL database into HDFS. The first example imports the entire categories table into HDFS. The second example imports only categories where the category ID is greater than 50. The third example imports the departments table where conditions are applied using $CONDITIONS. Each example is followed by commands to verify the import by listing and viewing the data in HDFS.

    Original Description:

    Cours Hadoop Sqoop

    Original Title

    02_Sqoop

    Copyright

    © © All Rights Reserved

    Available Formats

    DOCX, PDF, TXT or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    Report this Document
    This document provides 3 examples of using SQOOP to import data from a MySQL database into HDFS. The first example imports the entire categories table into HDFS. The second example imports only categories where the category ID is greater than 50. The third example imports the departments table where conditions are applied using $CONDITIONS. Each example is followed by commands to verify the import by listing and viewing the data in HDFS.

    Copyright:

    © All Rights Reserved
    Download as DOCX, PDF, TXT or read online from Scribd
    Flag for inappropriate content
    3 views2 pages

    02 Sqoop

    Uploaded by

    helmi.sassi.hs
    This document provides 3 examples of using SQOOP to import data from a MySQL database into HDFS. The first example imports the entire categories table into HDFS. The second example imports only categories where the category ID is greater than 50. The third example imports the departments table where conditions are applied using $CONDITIONS. Each example is followed by commands to verify the import by listing and viewing the data in HDFS.

    Copyright:

    © All Rights Reserved
    Download as DOCX, PDF, TXT or read online from Scribd
    Flag for inappropriate content
    of 2

    SQOOP

    http://archive-primary.cloudera.com/cdh5/cdh/5/sqoop-1.4.5-cdh5.3.2/SqoopUserGuide.html

    Import
    Supprimez /user/cloudera/demo s’il existe

    Exemple 1

    sqoop import --connect "jdbc:mysql://quickstart.cloudera:3306/retail_db" --username retail_dba --


    password cloudera --table categories --target-dir /user/cloudera/demo/categorie_1

    Vérifier

    hadoop fs -ls /user/cloudera/demo/categorie_1


    hadoop fs -cat /user/cloudera/demo/categorie_1/*

    Exemple 2

    sqoop import --connect "jdbc:mysql://quickstart.cloudera:3306/retail_db" --username


    retail_dba --password cloudera --table categories --target-dir
    /user/cloudera/demo/categorie_2 --m 1 --where "category_id > 50"

    Vérifier

    hadoop fs -ls /user/cloudera/demo/categorie_2


    hadoop fs -cat /user/cloudera/demo/categorie_2/*

    Exemple 3

    sqoop import --connect "jdbc:mysql://quickstart.cloudera:3306/retail_db" --username


    retail_dba --password cloudera --target-dir /user/cloudera/demo/departments --m 1 --query
    "select * from departments where \$CONDITIONS"

    Vérifier

    hadoop fs -ls /user/cloudera/demo/departments


    hadoop fs -cat /user/cloudera/demo/departments/*

    You might also like