Scribd Logo
Upload

Welcome to Scribd!

  • Optimization Algorithms: Mini-Batch Gradient Descent

    Uploaded by

    rwehjgrebg
    9 views3 pages
    Optimization algorithms like mini-batch gradient descent allow neural networks to be trained on large datasets. Mini-batch gradient descent computes the gradient over small batches of examples, called mini-batches, rather than individual examples. This allows gradient descent to converge faster while still benefiting from vectorization compared to batch gradient descent.

    Original Description:

    Original Title

    W2_Slides1.pptx

    Copyright

    © © All Rights Reserved

    Available Formats

    PPTX, PDF, TXT or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    Report this Document
    Optimization algorithms like mini-batch gradient descent allow neural networks to be trained on large datasets. Mini-batch gradient descent computes the gradient over small batches of examples, called mini-batches, rather than individual examples. This allows gradient descent to converge faster while still benefiting from vectorization compared to batch gradient descent.

    Copyright:

    © All Rights Reserved
    Download as PPTX, PDF, TXT or read online from Scribd
    Flag for inappropriate content
    9 views3 pages

    Optimization Algorithms: Mini-Batch Gradient Descent

    Uploaded by

    rwehjgrebg
    Optimization algorithms like mini-batch gradient descent allow neural networks to be trained on large datasets. Mini-batch gradient descent computes the gradient over small batches of examples, called mini-batches, rather than individual examples. This allows gradient descent to converge faster while still benefiting from vectorization compared to batch gradient descent.

    Copyright:

    © All Rights Reserved
    Download as PPTX, PDF, TXT or read online from Scribd
    Flag for inappropriate content
    of 3

    Optimization

    Algorithms

    Mini-batch
    deeplearning.ai
    gradient descent
    Batch vs. mini-batch gradient descent
    Vectorization allows you to efficiently compute on m examples.

    Andrew Ng
    Mini-batch gradient descent

    Andrew Ng

    You might also like