Scribd Logo
Upload

Welcome to Scribd!

  • On Car-Racing Env: Image-Based Path Planning Method

    Uploaded by

    Mayur Bhise
    5 views4 pages

    Original Title

    Ppo

    Copyright

    © © All Rights Reserved

    Available Formats

    PPTX, PDF, TXT or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    Report this Document

    Copyright:

    © All Rights Reserved
    Download as PPTX, PDF, TXT or read online from Scribd
    Flag for inappropriate content
    5 views4 pages

    On Car-Racing Env: Image-Based Path Planning Method

    Uploaded by

    Mayur Bhise

    Copyright:

    © All Rights Reserved
    Download as PPTX, PDF, TXT or read online from Scribd
    Flag for inappropriate content
    of 4

    PPO – ON CAR-RACING ENV

    IMAGE-BASED PATH PLANNING METHOD

    -MAYUR BHISE
    PPO

    • Advantage Function
    • Gradient Ascent (Trust Regions)
    • Actor-Critic
    • Clipped Objective Function
    ALGORITHM

    Reinforce
    • Importance Sampling
    • Unstable update • Variance is Different (Sample more Data)
    • KL Divergence
    • Large Step size – Bad Policy
    • Bad Samples – Worse Policy

    • Data Inefficiency
    • On – Policy Method
    • Data Thrown away
    • Training Slow
    CAR-RACING ENVIRONMENT

    You might also like