Scribd Logo
Upload

Welcome to Scribd!

  • Introduction To Data Engineering Profile

    Uploaded by

    reliable business
    8 views16 pages
    The document discusses the high demand for data engineers. It notes that as data from sources like social media, Google searches, and YouTube videos grows exponentially, we need dedicated professionals to handle large amounts of information. A data engineer's role is to manage data through the full life cycle from collection to storage to processing to analysis. Key responsibilities include working with big data tools and technologies to collect, organize, and prepare data to be analyzed by data scientists and business users.

    Original Description:

    Original Title

    Introduction+to+Data+Engineering+Profile

    Copyright

    © © All Rights Reserved

    Available Formats

    PDF, TXT or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    Report this Document
    The document discusses the high demand for data engineers. It notes that as data from sources like social media, Google searches, and YouTube videos grows exponentially, we need dedicated professionals to handle large amounts of information. A data engineer's role is to manage data through the full life cycle from collection to storage to processing to analysis. Key responsibilities include working with big data tools and technologies to collect, organize, and prepare data to be analyzed by data scientists and business users.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Flag for inappropriate content
    8 views16 pages

    Introduction To Data Engineering Profile

    Uploaded by

    reliable business
    The document discusses the high demand for data engineers. It notes that as data from sources like social media, Google searches, and YouTube videos grows exponentially, we need dedicated professionals to handle large amounts of information. A data engineer's role is to manage data through the full life cycle from collection to storage to processing to analysis. Key responsibilities include working with big data tools and technologies to collect, organize, and prepare data to be analyzed by data scientists and business users.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Flag for inappropriate content
    of 16

    Eshant Garg

    Azure Data Engineer, Architect, Advisor


    eshant.garg@gmail.com
    Learning Objectives

    • You will learn Why Data Engineer profile is in demand?


    • You will learn the difference between different Data Science related profiles
    • You will learn Data Engineer role and responsibilities
    • You will learn about Data Engineer technologies
    Data expanding
    When I say Everything
    is getting record.
    I mean it ☺
    Social media stats

    • Whatsapp handle 60 billion messages a day


    • Google process 40,000 search queries every second
    • Average user spends 35 minutes on Facebook a day
    • 500 million Tweets sent each day
    • 300 hours of video are uploaded to Youtube every minute
    Exponential growth of Data
    1 Zettabytes = 1 trillion Gigabyte
    Once upon a time ☺
    Data Engineer – Top in Demand Job
    Why Data Engineers?

    We need dedicated professionals


    in order to handle this large
    amount of information.
    Data Life Cycle

    Source: Microsoft
    Data Life Cycle

    Source: Microsoft
    Learning Outcome
    • You should now why Data Engineer role is in so much demand?
    • You should know Data Engineer role and responsibility
    • You should aware of Data Engineering technologies

    You might also like