Scribd Logo
Upload

Welcome to Scribd!

  • Algorithms For MR

    Uploaded by

    jefferyleclerc
    3 views7 pages
    This document discusses algorithms for MapReduce. It provides 3 key points: 1. It introduces design patterns for MapReduce computations using pseudocode to optimize computations and motivate different patterns. 2. It notes that specific examples provided are less important than the takeaways about designing MapReduce computations. 3. It addresses a problem of comparing word count outputs from Alice and Bob by mapping words to consistent reducers so their outputs can be directly compared.

    Original Description:

    Original Title

    AlgorithmsForMR

    Copyright

    © © All Rights Reserved

    Available Formats

    PDF, TXT or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    Report this Document
    This document discusses algorithms for MapReduce. It provides 3 key points: 1. It introduces design patterns for MapReduce computations using pseudocode to optimize computations and motivate different patterns. 2. It notes that specific examples provided are less important than the takeaways about designing MapReduce computations. 3. It addresses a problem of comparing word count outputs from Alice and Bob by mapping words to consistent reducers so their outputs can be directly compared.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Flag for inappropriate content
    3 views7 pages

    Algorithms For MR

    Uploaded by

    jefferyleclerc
    This document discusses algorithms for MapReduce. It provides 3 key points: 1. It introduces design patterns for MapReduce computations using pseudocode to optimize computations and motivate different patterns. 2. It notes that specific examples provided are less important than the takeaways about designing MapReduce computations. 3. It addresses a problem of comparing word count outputs from Alice and Bob by mapping words to consistent reducers so their outputs can be directly compared.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Flag for inappropriate content
    of 7

    Algorithms for MapReduce

    1
    Admin

    Assignment 1 released

    Cluster admin on vacation. . . in Florida:


    “Greetings from hurricane hit winter haven”

    2
    Takeaways
    Design MapReduce computations in pseudocode
    Optimize a computation, with motivation
    Patterns used

    Less Important
    These specific examples

    3
    Problem: Comparing Output
    Alice’s Word Counts Bob’s Word Counts
    a 20 i 13 why 12 a 20 hi 2
    hi 2 the 31 why 12 i 13
    the 31

    4
    Problem: Comparing Output
    Alice’s Word Counts Bob’s Word Counts
    a 20 i 13 why 12 a 20 hi 2
    hi 2 the 31 why 12 i 13
    the 31

    a 20 the 31 i 13
    a 20 the 31 i 13
    hi 2 why 12
    hi 2 why 12

    Send words to a consistent place


    5
    Problem: Comparing Output
    Alice’s Word Counts Bob’s Word Counts
    a 20 i 13 why 12 a 20 hi 2
    hi 2 the 31 why 12 i 13
    the 31
    Map

    a 20 the 31 i 13
    a 20 the 31 i 13
    hi 2 why 12
    hi 2 why 12

    Reduce
    Send words to a consistent place: reducers
    6
    Problem: Comparing Output
    Alice’s Word Counts Bob’s Word Counts
    a 20 i 13 why 12 a 20 hi 2
    hi 2 the 31 why 12 i 13
    the 31
    Map

    a 20 the 31 i 13 Unordered
    a 20 the 31 i 13 Alice/Bob
    hi 2 why 12
    hi 2 why 12

    Reduce
    Send words to a consistent place: reducers
    7

    You might also like