Open navigation menu

Welcome to Scribd!

12 The Problem of Local Optima C2W2L09

Uploaded by

0% found this document useful (0 votes)

3 views3 pages

Original Title

12 the Problem of Local Optima C2W2L09

Copyright

© © All Rights Reserved

Available Formats

PPTX, PDF, TXT or read online from Scribd

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Report this Document

Copyright:

© All Rights Reserved

Available Formats

Download as PPTX, PDF, TXT or read online from Scribd

Flag for inappropriate content

0% found this document useful (0 votes)

3 views3 pages

12 The Problem of Local Optima C2W2L09

Uploaded by

Copyright:

© All Rights Reserved

Available Formats

Download as PPTX, PDF, TXT or read online from Scribd

Flag for inappropriate content

Jump to Page

You are on page 1of 3

Search inside document

Optimization

Algorithms

The problem of
deeplearning.ai
local optima
Local optima in neural networks

Andrew Ng
Problem of plateaus

• Unlikely to get stuck in a bad local optima

• Plateaus can make learning slow

Andrew Ng

You might also like

00 Pytorch and Deep Learning Fundamentals PDF
Document44 pages
00 Pytorch and Deep Learning Fundamentals PDF
MAHMOUDI Oussama
No ratings yet
Lan Cabling Lesson Plan
Document8 pages
Lan Cabling Lesson Plan
Jonalyn Delara
No ratings yet
Data Collection Method Advantages Disadvantages
Document4 pages
Data Collection Method Advantages Disadvantages
Owais_Khuwaja_7129
No ratings yet
DL Notes 1 5 Deep Learning
Document189 pages
DL Notes 1 5 Deep Learning
sugumar
No ratings yet
Intro of Deep Learning
Document19 pages
Intro of Deep Learning
Antonio Victory
No ratings yet
Neural Networks For Machine Learning: Lecture 13a The Ups and Downs of Backpropagation
Document26 pages
Neural Networks For Machine Learning: Lecture 13a The Ups and Downs of Backpropagation
Mohammad Alzyoud
No ratings yet
YY-Deep Learning PDF
Document46 pages
YY-Deep Learning PDF
Abhijeet Keshri
No ratings yet
A Brief Introduction To Deep Learning
Document46 pages
A Brief Introduction To Deep Learning
Maxwell Anderson Ielpo do Amaral
No ratings yet
Bio-Inspired Computing - Metaheuristics
Document58 pages
Bio-Inspired Computing - Metaheuristics
Maroua Allaoui
No ratings yet
Introduction To Deep Learning: Welcome
Document27 pages
Introduction To Deep Learning: Welcome
George Hamilton
No ratings yet
EE2211 Lecture 9
Document31 pages
EE2211 Lecture 9
Tze Long Gan
No ratings yet
Ram PDF
Document19 pages
Ram PDF
Abhijeet Keshri
No ratings yet
Deep Learning Mar 19
Document2 pages
Deep Learning Mar 19
nikitataya
No ratings yet
Lit Deep Learning
Document19 pages
Lit Deep Learning
Saurav kumar
No ratings yet
An Introduction To AI: Week 1, Cohort 4
Document35 pages
An Introduction To AI: Week 1, Cohort 4
damola2real
No ratings yet
Deep Learning: IPAM Summer School 2012 Tutorial On
Document69 pages
Deep Learning: IPAM Summer School 2012 Tutorial On
Mahmood Kohansal
No ratings yet
Deeplearning - Ai Deeplearning - Ai
Document18 pages
Deeplearning - Ai Deeplearning - Ai
sumanroyal
No ratings yet
Neurosymbolic Presentation
Document42 pages
Neurosymbolic Presentation
MohammadErfan Jabbari
No ratings yet
Deeplearning - Ai Deeplearning - Ai
Document40 pages
Deeplearning - Ai Deeplearning - Ai
George Hamilton
No ratings yet
Introduction To Deep Learning: Technical Seminar by Md. Abul Fazl (14261A05A0) CSE Dept
Document21 pages
Introduction To Deep Learning: Technical Seminar by Md. Abul Fazl (14261A05A0) CSE Dept
pavansfdsf
No ratings yet
Serge Levine Course Introduction To Reinforcement Learning: 2 Imitation Learning
Document44 pages
Serge Levine Course Introduction To Reinforcement Learning: 2 Imitation Learning
Nathaniel Saura
No ratings yet
Deep Belief Nets: 2007 NIPS Tutorial On
Document100 pages
Deep Belief Nets: 2007 NIPS Tutorial On
Firomsa Tesfaye
No ratings yet
Neural Networks - Comprehensive Foundation (Introduction)
Document47 pages
Neural Networks - Comprehensive Foundation (Introduction)
Guillermo Orozco
No ratings yet
Deep Learning State of The Art: Amulya Viswambharan ID 202090007 Kehkshan Fatima ID
Document17 pages
Deep Learning State of The Art: Amulya Viswambharan ID 202090007 Kehkshan Fatima ID
Amulya
No ratings yet
8.2 NNOptimization
Document17 pages
8.2 NNOptimization
Nitish Ravuvari
No ratings yet
Unit 1 - How To Access The Portal: Announcements Ask A Question Progress Mentor FAQ
Document4 pages
Unit 1 - How To Access The Portal: Announcements Ask A Question Progress Mentor FAQ
Neeraj Idnani
No ratings yet
HDEE Gamemaster Aids
Document2 pages
HDEE Gamemaster Aids
alfred
No ratings yet
Deep Learning Nanodegree Syllabus 8-15
Document11 pages
Deep Learning Nanodegree Syllabus 8-15
SANTIAGO PUJOL ZABALA
No ratings yet
Deep Learning: Seungsang Oh
Document6 pages
Deep Learning: Seungsang Oh
KaAI Kookmin
No ratings yet
ITNN_Week3
Document21 pages
ITNN_Week3
shalinipriya
No ratings yet
Artificial Neural Network
Document29 pages
Artificial Neural Network
Ashutosh Shukla
No ratings yet
Final Demo DLP For Checking
Document6 pages
Final Demo DLP For Checking
Aimee Joy L Hermosora
No ratings yet
Lecture 9 Training Deep Networks
Document20 pages
Lecture 9 Training Deep Networks
Utkarsh Bhalode
No ratings yet
Fpga Implementation of Neural Networks: Main Contents
Document21 pages
Fpga Implementation of Neural Networks: Main Contents
atef Benhaoues
No ratings yet
LP 2 PDF
Document10 pages
LP 2 PDF
Gelo Guzman
No ratings yet
Technology: Irene R. Cajano
Document22 pages
Technology: Irene R. Cajano
Anonymous 6obMuYfig7
No ratings yet
Unit 3 - Diving - Deep - Learning
Document108 pages
Unit 3 - Diving - Deep - Learning
Alekhya Roy
No ratings yet
Some Topics: - Exponential Tricks - Denial-Of-Service Attacks (No Time For It Today)
Document7 pages
Some Topics: - Exponential Tricks - Denial-Of-Service Attacks (No Time For It Today)
postscript
No ratings yet
Recruitment
Document1 page
Recruitment
Ambati Hari Krishna
No ratings yet
Data Science 4B
Document55 pages
Data Science 4B
kagome
No ratings yet
Presented By, Shobha C.Hiremath (01FE17MCS019)
Document25 pages
Presented By, Shobha C.Hiremath (01FE17MCS019)
shobha hiremath
No ratings yet
M3_L1
Document27 pages
M3_L1
Anitha Saravanan
No ratings yet
Lec 2 Supervised Learning Behaviors
Document44 pages
Lec 2 Supervised Learning Behaviors
ghauch
No ratings yet
Methods of Data Collection Advantages and Disadvantages
Document4 pages
Methods of Data Collection Advantages and Disadvantages
loverboy_q_s
100% (2)
Geoffrey Hinton With Nitish Srivastava Kevin Swersky: Neural Networks For Machine Learning
Document32 pages
Geoffrey Hinton With Nitish Srivastava Kevin Swersky: Neural Networks For Machine Learning
Mohamed Mostafa
No ratings yet
Coding
Document1 page
Coding
Name
No ratings yet
PROBLEMSOLVING
Document1 page
PROBLEMSOLVING
pratikthegreathero
No ratings yet
2d3dai Continual Learning
Document36 pages
2d3dai Continual Learning
for masters
No ratings yet
Unit-Ii Deep Learning Techniues
Document51 pages
Unit-Ii Deep Learning Techniues
Temperory Mail
No ratings yet
Deep Learning and Applications: Pham The Bao Ptbao@sgu - Edu.vn
Document43 pages
Deep Learning and Applications: Pham The Bao Ptbao@sgu - Edu.vn
Xuân Xuânn
No ratings yet
A.I. Techniques Implementation
Document20 pages
A.I. Techniques Implementation
sumit208
No ratings yet
Lecture 4
Document17 pages
Lecture 4
Mujeeb khan
No ratings yet
Hussain 62692
Document3 pages
Hussain 62692
Hussain - حسين
No ratings yet
AIFA 1 Introduction 020124
Document32 pages
AIFA 1 Introduction 020124
Jay Nagwani
No ratings yet
Deep Learning Nanodegree Syllabus 8-15
Document15 pages
Deep Learning Nanodegree Syllabus 8-15
Mostafa Magdy
No ratings yet
Chapter 1 - Introduction To Neuro-Fuzzy and Soft Computing
Document16 pages
Chapter 1 - Introduction To Neuro-Fuzzy and Soft Computing
Isha Keshav
No ratings yet
Ilovepdf Merged
Document3 pages
Ilovepdf Merged
Hussain - حسين
No ratings yet
Unsupervised Learning, Neural Networks
Document22 pages
Unsupervised Learning, Neural Networks
Shraddha Dubey
No ratings yet
Optimization Algorithms: Learning Rate Decay
Document4 pages
Optimization Algorithms: Learning Rate Decay
rwehjgrebg
No ratings yet
W2 Slides7
Document2 pages
W2 Slides7
rwehjgrebg
No ratings yet
Optimization Algorithms Bias Correction in Exponentially Weighted Average
Document2 pages
Optimization Algorithms Bias Correction in Exponentially Weighted Average
rwehjgrebg
No ratings yet
Optimization Algorithms Understanding Mini-Batch Gradient Descent
Document4 pages
Optimization Algorithms Understanding Mini-Batch Gradient Descent
rwehjgrebg
No ratings yet
Ghanta
Document15 pages
Ghanta
rwehjgrebg
No ratings yet
Optimization Algorithms: Mini-Batch Gradient Descent
Document3 pages
Optimization Algorithms: Mini-Batch Gradient Descent
rwehjgrebg
No ratings yet
Paleopathology: The Study of Disease in Prehistoric Times
Document50 pages
Paleopathology: The Study of Disease in Prehistoric Times
rwehjgrebg
No ratings yet