Scribd Logo
Upload

Welcome to Scribd!

  • Eye and Mouth State Detection Algorithm Based On Contour Feature Extraction

    Uploaded by

    Silvana Man
    15 views19 pages
    The document describes an algorithm for detecting eye and mouth states based on contour feature extraction. It first detects the face using Viola-Jones detection, then extracts the eye and mouth regions of interest. It applies algorithms like EyeMap and OTSU thresholding to detect the eyes, and color segmentation to detect the mouth. Features like the eye contour, sclera region, and mouth internal contour are extracted. These features are then used to analyze the eye and mouth states and determine if the eyes are open or closed and if the mouth is open. The algorithm achieved 98.67% accuracy for eye state detection and 97.5% accuracy for mouth state detection.

    Original Description:

    Original Title

    IOC-SILVANA-MAN.pptx

    Copyright

    © © All Rights Reserved

    Available Formats

    PPTX, PDF, TXT or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    Report this Document
    The document describes an algorithm for detecting eye and mouth states based on contour feature extraction. It first detects the face using Viola-Jones detection, then extracts the eye and mouth regions of interest. It applies algorithms like EyeMap and OTSU thresholding to detect the eyes, and color segmentation to detect the mouth. Features like the eye contour, sclera region, and mouth internal contour are extracted. These features are then used to analyze the eye and mouth states and determine if the eyes are open or closed and if the mouth is open. The algorithm achieved 98.67% accuracy for eye state detection and 97.5% accuracy for mouth state detection.

    Copyright:

    © All Rights Reserved
    Download as PPTX, PDF, TXT or read online from Scribd
    Flag for inappropriate content
    15 views19 pages

    Eye and Mouth State Detection Algorithm Based On Contour Feature Extraction

    Uploaded by

    Silvana Man
    The document describes an algorithm for detecting eye and mouth states based on contour feature extraction. It first detects the face using Viola-Jones detection, then extracts the eye and mouth regions of interest. It applies algorithms like EyeMap and OTSU thresholding to detect the eyes, and color segmentation to detect the mouth. Features like the eye contour, sclera region, and mouth internal contour are extracted. These features are then used to analyze the eye and mouth states and determine if the eyes are open or closed and if the mouth is open. The algorithm achieved 98.67% accuracy for eye state detection and 97.5% accuracy for mouth state detection.

    Copyright:

    © All Rights Reserved
    Download as PPTX, PDF, TXT or read online from Scribd
    Flag for inappropriate content
    of 19

    EYE AND MOUTH STATE

    DETECTION
    ALGORITHM BASED ON
    CONTOUR FEATURE
    EXTRACTION
    STUDENT: MAN LARISA SILVANA
    INTRODUCERE

     Detectia oboselii
     Parametri fiziologici
     Comportamentul vehiculului
     Analiza caracteristicilor faciale
    EYE AND MOUTH
    STATE DETECTION
    ALGORITHM
    BASED ON
    CONTOUR
    FEATURE
    EXTRACTION
    FACE DETECTION

     Viola Jones
     Clasificator tip cascada
     Algoritm AdaBoost
    EYE DETECTION

     Determinarea regiunii de interes ROI


     Detectia fetei  extragere jumatatea superioara  se
    indeparteaza prima optime  restul se marcheaza ca ROI
     Algoritm EyeMap
     EyeMapC – componentele de crominanta
     EyeMapL – componentele de luminanta

     Normalizare in intervalul [0,255]


    EYE DETECTION
     Algoritm EyeMap

    Illustration of EyeMap construction: (a) the original eye ROI region.


    (b) EyeMapC. (c) EyeMapL. (d) EyeMap
    EYE DETECTION

     Algoritm OTSI : EyeMap  imagine binara  prag T


     Componente conectate

    Different steps of our eye detection method: (a) EyeMap image after


    binarization. (b) A pair of connected components. (c) Calibrate eye
    region with a rectangular box.
    MOUTH DETECTION
     Detectia fetei  extragere treimea inferioara jumatea din mijloc
     se marcheaza ca ROI
     Diferenta culorilor buzelor si pielii  segmentarea buzelor

    Different steps of our mouth detection method: (a) Initial mouth


    ROI. (b) Mouth opens widely. (c) Final mouth ROI. (d) Selected
    20% pixels.
    MOUTH DETECTION

     S (buze) > S (piele)


     N0 – nr pixeli in regiunea buzelor
     Clasam toate valorile de saturatie a pixelilor
     Selectam N0 pixeli cu cea mai mare valoare
     N0 = 20%
    CONTOUR FEATURE EXTRACTION - EYE CONTOUR
    EXTRACTION

     Excludere impact iris si gene


     Prag de segmentare T prin algortim OTSI
     Impartire ochi: iris si regiunea genelor
     Diferenta componenta Red si Blue intre clear si piele  K-means clustering
     Analiza S (HSV space)  sclera region

    Illustration of sclera extraction: (a) Iris and eyelash regions. (b) Eye region is


    divided into three parts. (c) Sclera region.
    CONTOUR FEATURE EXTRACTION - EYE CONTOUR
    EXTRACTION

     Curba cuadratica peantru a potrivi pleoapele superioara si inferioare


     Dreptunghiul minim circumscris  ochi deschis sau inchis?

    Illustration of contour fitting: (a) Upper and lower eyelids after contour fitting.
    (b) Minimum circumscribed rectangle.
    CONTOUR FEATURE EXTRACTION-EYE -MOUTH INTERNAL
    CONTOUR EXTRACTION
     R-G: buze > piele > interiorul gurii
     Separare interiorul gurii – segmentare dupa pragul T

    Illustration of mouth internal contour extraction steps: (a) Binary image after threshold segmentation.
    (b) Mouth inner area. (c) Mouth contour fitting. (d) Minimum circumscribed rectangle of the mouth
    contour.
    CONTOUR FEATURE EXTRACTION-EYE -MOUTH INTERNAL
    CONTOUR EXTRACTION
     R-G: buze > piele > interiorul gurii
     Separare interiorul gurii – segmentare dupa pragul T

    Illustration of mouth internal contour extraction steps: (a) Binary image after threshold segmentation.
    (b) Mouth inner area. (c) Mouth contour fitting. (d) Minimum circumscribed rectangle of the mouth
    contour.
    STATE ANALYSIS AND
    TEST RESULTS
    EYE STATE ANALYSIS

     Determinare starea ochiului


     M – inchiderea pleoapelor
     Standard P80  T = 0.1125 M < 0.15
     Acuratete 98.67%
    MOUTH STATE ANALYSIS

     Determinate deschiderea gurii N


     N > 0.75  cascat
     Acuratete 97.5%
    TEST AND EXPERIMENTAL RESULTS

    Eye contour
    fitting
    results
    obtained by
    the proposed
    algorithm.
    TEST AND EXPERIMENTAL RESULTS

    Eye contour fitting results obtained by the proposed algorithm.


    BIBLIOGRAPHY

     Yingyu Ji, Shigang Wang, Yang Lu, Jian Wei, Yan Zhao, "Eye and mouth state detection algorithm based on
    contour feature extraction," J. Electron. Imag. 27(5) 051205 (9 February 2018)
     https://doi.org/10.1117/1.JEI.27.5.051205

    You might also like