Scribd Logo
Upload

Welcome to Scribd!

  • Hadoop Commonds

    Uploaded by

    Yajnesh Alankalya
    3 views1 page
    The document provides commands for checking Java and HDFS versions, starting and stopping Hadoop, navigating directories on HDFS, creating directories and pushing files to HDFS, listing directory contents on HDFS, displaying file contents from HDFS, creating a MapReduce project and JAR file in Eclipse, running a MapReduce program on HDFS input and output directories, and verifying the MapReduce output.

    Original Description:

    Original Title

    hadoop commonds

    Copyright

    © © All Rights Reserved

    Available Formats

    TXT, PDF, TXT or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    Report this Document
    The document provides commands for checking Java and HDFS versions, starting and stopping Hadoop, navigating directories on HDFS, creating directories and pushing files to HDFS, listing directory contents on HDFS, displaying file contents from HDFS, creating a MapReduce project and JAR file in Eclipse, running a MapReduce program on HDFS input and output directories, and verifying the MapReduce output.

    Copyright:

    © All Rights Reserved
    Download as TXT, PDF, TXT or read online from Scribd
    Flag for inappropriate content
    3 views1 page

    Hadoop Commonds

    Uploaded by

    Yajnesh Alankalya
    The document provides commands for checking Java and HDFS versions, starting and stopping Hadoop, navigating directories on HDFS, creating directories and pushing files to HDFS, listing directory contents on HDFS, displaying file contents from HDFS, creating a MapReduce project and JAR file in Eclipse, running a MapReduce program on HDFS input and output directories, and verifying the MapReduce output.

    Copyright:

    © All Rights Reserved
    Download as TXT, PDF, TXT or read online from Scribd
    Flag for inappropriate content
    of 1

    java version check

    java -version

    HDFS version check


    hdfs version

    To start Hadoop
    /usr/local/hadoop/sbin/./start-all.sh
    To stop Hadoop
    /usr/local/hadoop/sbin/./start-all.sh

    pwd

    To directory content on HDFS


    hadoop fs -ls
    hadoop fs -ls /

    To Create a Directory on HDFS


    hadoop fs -mkdir /inputdata

    To push existing file to HDFS directory


    hadoop fs -put test.txt /inputdata

    To verify the HDFS directory content


    hadoop fs -ls /inputdata

    To display the file content form HDFS system


    hadoop fs -cat /inputdata/test.txt

    Steps to use eclipse to create project and jar files refer the following link
    https://dzone.com/articles/word-count-hello-word-program-in-mapreduce

    To run mapreduce program


    hadoop jar wordcount.jar /inputdata /outputdata
    NOTE: HADOOP DEMANDS NEW OUTPUT FOLDER NAME ON EACH RUN

    Verify the output directory content


    hadoop fs -ls /outputdata

    To display the output file content form HDFS system


    hadoop fs -cat /outputdata/part-r-00000

    You might also like