Scribd Logo
Upload

Welcome to Scribd!

  • Local Learning Capabili - Es Will Lead To A Breakthrough of Brain - Inspired Compu - NG

    Uploaded by

    nanoteraCH
    103 views11 pages
    The document discusses local learning capabilities leading to breakthroughs in brain-inspired computing. It describes several brain-inspired computing projects including a many-core machine with 500,000 cores and a physical model machine with 20 wafer modules and accelerated processing. These machines aim to simulate the brain across timescales from milliseconds to millennia through accelerated neural models. Reinforcement learning is discussed as applied to games with strategic networks learning from examples and policy networks learning through self-play. Hierarchical temporal memory is proposed as a model for online plasticity in structured neurons.

    Original Description:

    SOETC Conference

    Original Title

    Meier

    Copyright

    © © All Rights Reserved

    Available Formats

    PDF, TXT or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    Report this Document
    The document discusses local learning capabilities leading to breakthroughs in brain-inspired computing. It describes several brain-inspired computing projects including a many-core machine with 500,000 cores and a physical model machine with 20 wafer modules and accelerated processing. These machines aim to simulate the brain across timescales from milliseconds to millennia through accelerated neural models. Reinforcement learning is discussed as applied to games with strategic networks learning from examples and policy networks learning through self-play. Hierarchical temporal memory is proposed as a model for online plasticity in structured neurons.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Flag for inappropriate content
    103 views11 pages

    Local Learning Capabili - Es Will Lead To A Breakthrough of Brain - Inspired Compu - NG

    Uploaded by

    nanoteraCH
    The document discusses local learning capabilities leading to breakthroughs in brain-inspired computing. It describes several brain-inspired computing projects including a many-core machine with 500,000 cores and a physical model machine with 20 wafer modules and accelerated processing. These machines aim to simulate the brain across timescales from milliseconds to millennia through accelerated neural models. Reinforcement learning is discussed as applied to games with strategic networks learning from examples and policy networks learning through self-play. Hierarchical temporal memory is proposed as a model for online plasticity in structured neurons.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Flag for inappropriate content
    of 11

    Local

    learning capabili.es will lead


    to a breakthrough of brain-inspired
    compu.ng

    Symposium on Emerging Trends in Compu2ng
    Montreux October 2016

    Karlheinz Meier
    Ruprecht-Karls-Universitt Heidelberg

    meierk@kip.uni-heidelberg.de
    @brainscales

    Jumpstart

    Strategic Network
    Supervised Learning
    Learn to predict human moves
    database of exis.ng matches
    160.000 matches, 30 Million posi.ons

    Policy Network

    Reinforcement Learning
    Network self-matches
    128.000.000 matches

    Value Network

    Combina.on of rst 2 steps


    30 Million self-matches

    Learning is slow and energy


    expensive (months)

    Applica9on is fast (minutes)

    (A) Two layers of a convolutional network.

    TrueNorth
    Energy efficient
    implementation of a
    convolutional network
    model that shares
    properties with networks
    of neurons in the brain
    Close to human
    performance in
    recognizing images and
    sounds

    Steven K. Esser et al. PNAS doi:10.1073/pnas.1604850113

    External backpropagation
    learning with virtual
    smooth activation function

    System-in-the-Loop

    Many-Core Machine
    500.000 Cores
    Real Time Simulator
    Manchester (UK)

    Physical Model Machine


    20 Wafer Modules
    X10.000 accelerated System
    Heidelberg (GE)

    Both machines opera.onal since March 30th 2016


    Part the Human Brain Project (HBP) plaZorm system

    TimeScales

    Nature +
    Real-.me

    Simula.on

    Accelerated
    Model

    Causality Detec.on

    10-4 s

    0.1 s

    10-8 s

    Synap.c Plas.city

    1 s

    1000 s

    10-4 s

    Learning

    Day

    1000 Days

    10 s

    Development

    Year

    1000 Years

    3000 s

    12 Orders of Magnitude
    Evolu.on

    > Millenia

    > 1000
    Millenia

    > 15 Orders of Magnitude

    > Months

    Data or simulated
    environment

    Reward (penalty)

    Reward calcula.on

    State of data or
    environment

    Ac.on of machine on
    data or environment

    Phase-2 BrainScaleS chip in the EU Human Brain Project


    HYBRID PLASTICITY

    Observables
    Synapse evalua.on

    Controls
    External rewards
    and controls

    Weights

    Neuron parameters
    Homeostasis

    Popula.on rates

    S.mulus generators
    Arbitrary internal
    parameters

    On-chip
    SIMD
    Power PC

    Connec.vity
    Rewiring

    Essen.al : Any .mescale > ms (bio) is accessible

    Hierarchical Temporal
    Memory (HTM)
    using spiking LIF neurons

    Online plas.city and


    structured neurons

    HBP phase-2 systems will


    be op.mized for HTM

    hfp://arxiv.org/abs/
    1505.02142

    Predict
    New York
    taxi
    demand

    Con.nuous online sequence


    learning with an unsupervised
    neural network model

    Yuwei Cui*, Subutai Ahmad, and
    Je Hawkins

    Numenta, Inc,
    Redwood City, California, USA

    arXiv:1512.05463

    You might also like