Scribd Logo
Upload

Welcome to Scribd!

  • 2017 - Lecture 5 - Smaller Network - CNN - 3 (Ming Li) (8 Slides)

    Uploaded by

    rvasiliou
    2 views8 pages
    The document appears to be about convolutional neural networks (CNNs) and includes examples of using CNNs for image classification, speech recognition, and text classification. It discusses CNN architecture components like convolution, pooling, and fully connected layers. It also provides examples of CNN applications in AlphaGo for game play and comparing CNN to fully connected networks.

    Original Description:

    Lecture 5 - Smaller Network - CNN [Ming Li]

    Original Title

    2017 - Lecture 5 - Smaller Network - CNN - 3 [Ming Li][8 Slides]

    Copyright

    © © All Rights Reserved

    Available Formats

    PPT, PDF, TXT or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    Report this Document
    The document appears to be about convolutional neural networks (CNNs) and includes examples of using CNNs for image classification, speech recognition, and text classification. It discusses CNN architecture components like convolution, pooling, and fully connected layers. It also provides examples of CNN applications in AlphaGo for game play and comparing CNN to fully connected networks.

    Copyright:

    © All Rights Reserved
    Download as PPT, PDF, TXT or read online from Scribd
    Flag for inappropriate content
    2 views8 pages

    2017 - Lecture 5 - Smaller Network - CNN - 3 (Ming Li) (8 Slides)

    Uploaded by

    rvasiliou
    The document appears to be about convolutional neural networks (CNNs) and includes examples of using CNNs for image classification, speech recognition, and text classification. It discusses CNN architecture components like convolution, pooling, and fully connected layers. It also provides examples of CNN applications in AlphaGo for game play and comparing CNN to fully connected networks.

    Copyright:

    © All Rights Reserved
    Download as PPT, PDF, TXT or read online from Scribd
    Flag for inappropriate content
    of 8

    3

    Flattening
    0

    1
    3 0
    -1 1 3

    30 1 -1
    3 Flattened
    Fully Connected
    1 Feedforward network

    3
    Only modified the network structure and
    CNN in Keras input format (vector -> 3-D tensor)

    input

    Convolution
    1 -1 -1
    -1 1 -1
    -1 1 -1
    -1 1 -1 … There are
    -1 -1 1 25 3x3
    -1 1 -1 … Max Pooling
    filters.
    Input_shape = ( 28 , 28 , 1)

    28 x 28 pixels 1: black/white, 3: RGB Convolution

    3 -1 3 Max Pooling

    -3 1
    Only modified the network structure and
    CNN in Keras input format (vector -> 3-D array)

    Input
    1 x 28 x 28

    Convolution
    How many parameters for
    each filter? 9 25 x 26 x 26

    Max Pooling
    25 x 13 x 13

    Convolution
    How many parameters 225=
    for each filter? 50 x 11 x 11
    25x9
    Max Pooling
    50 x 5 x 5
    Only modified the network structure and
    CNN in Keras input format (vector -> 3-D array)

    Input
    1 x 28 x 28

    Output Convolution

    25 x 26 x 26
    Fully connected Max Pooling
    feedforward network
    25 x 13 x 13

    Convolution
    50 x 11 x 11

    Max Pooling
    1250 50 x 5 x 5
    Flattened
    AlphaGo

    Next move
    Neural
    (19 x 19
    Network positions)

    19 x 19 matrix
    Black: 1 Fully-connected feedforward
    network can be used
    white: -1
    none: 0 But CNN performs much better
    AlphaGo’s policy network
    The following is quotation from their Nature article:
    Note: AlphaGo does not use Max Pooling.
    CNN in speech recognition

    The filters move in the


    CNN frequency direction.
    Frequency

    Image Time
    Spectrogram
    CNN in text classification

    Source of image: http://citeseerx.ist.psu.ed


    u/viewdoc/download?doi=10.1.1.703.6858
    &rep=rep1&type=pdf

    You might also like