Scribd Logo
Upload

Welcome to Scribd!

  • Preprocessing Video Images For Neural Learning of Lipreading

    Uploaded by

    Roshan
    8 views11 pages
    This document summarizes research on preprocessing video images to improve neural learning for lipreading. The researchers preprocessed video frames by extracting the mouth region, converting to grayscale, and tracking mouth features like width, height and vertical gap over time. This preprocessing extracts the visual speech information and removes irrelevant background details, helping neural networks better learn visual speech patterns and distinguish between visually similar words and sounds.

    Original Description:

    Info in notepad

    Original Title

    Wt to say

    Copyright

    © © All Rights Reserved

    Available Formats

    PDF, TXT or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    Report this Document
    This document summarizes research on preprocessing video images to improve neural learning for lipreading. The researchers preprocessed video frames by extracting the mouth region, converting to grayscale, and tracking mouth features like width, height and vertical gap over time. This preprocessing extracts the visual speech information and removes irrelevant background details, helping neural networks better learn visual speech patterns and distinguish between visually similar words and sounds.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Flag for inappropriate content
    8 views11 pages

    Preprocessing Video Images For Neural Learning of Lipreading

    Uploaded by

    Roshan
    This document summarizes research on preprocessing video images to improve neural learning for lipreading. The researchers preprocessed video frames by extracting the mouth region, converting to grayscale, and tracking mouth features like width, height and vertical gap over time. This preprocessing extracts the visual speech information and removes irrelevant background details, helping neural networks better learn visual speech patterns and distinguish between visually similar words and sounds.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Flag for inappropriate content
    of 11

    Preprocessing video images for neural learning of lipreading 

    K. Venkatesh Prasad, David G. Stork, Gregory J. Wol


    Machine Learning and Perception Group
    Ricoh California Research Center
    2882 Sand Hill Road, Suite 115
    Menlo Park, CA 94025-7022
    mlp@crc.ricoh.com

    Abstract
    W
    2 Ricoh California Research Center Technical Report # 93{26
    and vice versa. Thus, for example =mi= $ =ni= are highly confusable acoustically but are easily distinguished based
    on the visual information of lip closure. Conversely, =bi= $ =pi= are highly confusable visually (\visemes"), but are
    easily distinguished acoustically by the voice-onset time (the delay between the burst sound and the onset of vocal fold
    vibration). Th
    4 Ricoh California Research Center Technical Report # 93z26

    A{B
    Preprocessing Video for Lipreading 5

    Gray Level
    6 Ricoh California Research Center Technical Report # 93{26

    i=1 ...

    v-1
    8 Ricoh California Research Center Technical Report # 93{26
    vertical mouth_gap (pixels)

    25

    20

    15

    10

    5
    1 10 33 50
    time (frame number) --->
    Preprocessing Video for Lipreading 9

    ts
    uni
    p -
    ts
    uni
    x -

    You might also like