Scribd Logo
Upload

Welcome to Scribd!

  • SP06-Apache Spark in IDE

    Uploaded by

    Viral
    3 views3 pages
    Spark is a unified analytics engine for large-scale data processing. It provides abstractions and an easy to use platform. Key parameters for configuring Spark include log4j properties, log file names, and Yarn container log directories.

    Original Description:

    Course

    Original Title

    SP06-Apache+Spark+in+IDE

    Copyright

    © © All Rights Reserved

    Available Formats

    PDF, TXT or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    Report this Document
    Spark is a unified analytics engine for large-scale data processing. It provides abstractions and an easy to use platform. Key parameters for configuring Spark include log4j properties, log file names, and Yarn container log directories.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Flag for inappropriate content
    3 views3 pages

    SP06-Apache Spark in IDE

    Uploaded by

    Viral
    Spark is a unified analytics engine for large-scale data processing. It provides abstractions and an easy to use platform. Key parameters for configuring Spark include log4j properties, log file names, and Yarn container log directories.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Flag for inappropriate content
    of 3

    Apache Spark

    Configuring Spark IDE


    Project Resources:
    https://github.com/LearningJournal/SparkProgrammingInScala

    JVM Parameters:
    -Dlog4j.configuration=file:log4j.properties -Dlogfile.name=hello-spark -Dspark.yarn.app.container.log.dir=app-logs
    Why Spark?

    1. Abstraction
    2. Unified Platform
    3. Ease of Use

    You might also like