Scribd Logo
Upload

Welcome to Scribd!

  • Apache Spark

    Uploaded by

    Salah Eddine Hebabaze
    63 views5 pages
    This document provides 3 steps for processing a text file in HDFS using PySpark: 1) Open the input.txt file using gedit, 2) Upload the input.txt file to HDFS using hdfs dfs -put input.txt, 3) Launch PySpark to access and analyze the file.

    Original Description:

    Spark python

    Copyright

    © © All Rights Reserved

    Available Formats

    PDF, TXT or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    Report this Document
    This document provides 3 steps for processing a text file in HDFS using PySpark: 1) Open the input.txt file using gedit, 2) Upload the input.txt file to HDFS using hdfs dfs -put input.txt, 3) Launch PySpark to access and analyze the file.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Flag for inappropriate content
    63 views5 pages

    Apache Spark

    Uploaded by

    Salah Eddine Hebabaze
    This document provides 3 steps for processing a text file in HDFS using PySpark: 1) Open the input.txt file using gedit, 2) Upload the input.txt file to HDFS using hdfs dfs -put input.txt, 3) Launch PySpark to access and analyze the file.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Flag for inappropriate content
    of 5

    •

    •
    •

    •
    • gedit input.txt
    • hdfs dfs -put input.txt
    • pyspark

    •
    •

    You might also like