Scribd Logo
Upload

Welcome to Scribd!

  • Rafael Rangga - IF-7

    Uploaded by

    andikayur54
    6 views7 pages
    The document contains code to implement Q-learning in Python to solve a 5x6 gridworld environment. It imports NumPy, initializes the environment matrix and Q-table, sets hyperparameters, then runs the Q-learning algorithm over 1000 epochs to learn the optimal policy. It updates the Q-table based on rewards received from actions in each state and checks if the goal state is reached.

    Original Description:

    Original Title

    10123265_Rafael Rangga_IF-7

    Copyright

    © © All Rights Reserved

    Available Formats

    PDF, TXT or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    Report this Document
    The document contains code to implement Q-learning in Python to solve a 5x6 gridworld environment. It imports NumPy, initializes the environment matrix and Q-table, sets hyperparameters, then runs the Q-learning algorithm over 1000 epochs to learn the optimal policy. It updates the Q-table based on rewards received from actions in each state and checks if the goal state is reached.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Flag for inappropriate content
    6 views7 pages

    Rafael Rangga - IF-7

    Uploaded by

    andikayur54
    The document contains code to implement Q-learning in Python to solve a 5x6 gridworld environment. It imports NumPy, initializes the environment matrix and Q-table, sets hyperparameters, then runs the Q-learning algorithm over 1000 epochs to learn the optimal policy. It updates the Q-table based on rewards received from actions in each state and checks if the goal state is reached.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Flag for inappropriate content
    of 7

    i

    mpor
    tnumpyasnp

    #Mat
    ri
    ksr
    epr
    esent
    asi
    li
    ngkungan

    #0:
    jal
    ur,
    1:r
    int
    angan,
    2:t
    ujuan

    env
    ironment=np.
    arr
    ay(
    [

    [
    0,0,
    0,1,
    0,0]
    ,

    [
    0,1,
    0,1,
    0,0]
    ,

    [
    0,1,
    0,0,
    0,2]
    ,

    [
    0,0,
    0,1,
    1,0]
    ,

    [
    1,0,
    0,0,
    0,0]

    ]
    )

    #I
    nisi
    ali
    sasi
    par
    amet
    erQ-
    tabl
    e

    q_
    tabl
    e=np.
    zer
    os(
    (5,
    6))

    #Hy
    per
    par
    amet
    ers

    l
    ear
    ning_
    rat
    e=0.
    1

    di
    scount
    _fact
    or=0.
    9

    expl
    orat
    ion_
    rat
    e=0.
    1

    epochs=1000

    #Al
    gor
    it
    maQ-
    Lear
    ning

    f
    orepochi
    nrange(
    epochs)
    :

    st
    ate=(
    0,0)#Agenmul
    aidar
    iti
    ti
    kawal

    whi
    l
    eTr
    ue:

    #Memi
    l
    iht
    indakan(
    act
    ion)

    i
    fnp.
    random.
    uni
    for
    m(0,
    1)<expl
    orat
    ion_
    rat
    e:

    act
    ion=np.
    random.
    randi
    nt(
    0,4)#Pi
    l
    ihaksi
    acak

    el
    se:

    act
    ion=np.
    argmax(
    q_t
    abl
    e[st
    ate]
    )#Pi
    l
    ihaksi
    ter
    bai
    kber
    dasar
    kanQ-
    tabl
    e
    #Mel
    akukant
    indakandanmendapat
    kanr
    ewar
    d

    next
    _st
    ate=(
    stat
    e[0]+(
    act
    ion==0)-(
    act
    ion==1)
    ,st
    ate[
    1]+(
    act
    ion==2)-(
    act
    ion==3)
    )

    r
    ewar
    d=-
    1ifenv
    ironment
    [next
    _st
    ate]==0el
    se(
    10i
    fenv
    ironment
    [next
    _st
    ate]==2el
    se-
    100)

    #Updat
    eQ-
    tabl
    eber
    dasar
    kanr
    ewar
    d

    q_
    tabl
    e[st
    ate]
    [act
    ion]=q_
    tabl
    e[st
    ate]
    [act
    ion]+l
    ear
    ning_
    rat
    e*(

    r
    ewar
    d+di
    scount
    _fact
    or*np.
    max(
    q_t
    abl
    e[next
    _st
    ate]
    )-q_
    tabl
    e[st
    ate]
    [act
    ion]
    )

    st
    ate=next
    _st
    ate

    #Mengecekapakahagent
    elahmencapai
    tuj
    uanat
    aumencapai
    bat
    asi
    ter
    asi

    i
    fenv
    ironment
    [st
    ate]==2orepoch==epochs-1:

    br
    eak

    #Pr
    intQ-
    tabl
    ehasi
    lpembel
    ajar
    an

    pr
    int
    ("
    Q-t
    abl
    e:"
    )

    pr
    int
    (q_
    tabl
    e)

    You might also like