Professional Documents
Culture Documents
Abstract—This paper describes a cellular nanoscale network over existing SPICE models are highlighted. Then, using mem-
cell structure that is aimed to be built as a CMOS-nanomemristor ristors for performing material implication logic is reviewed.
hybrid. The processing cell uses memristors as ON-OFF pro- Finally, the structure of a CNN cell (CMOS/memristor hybrid)
grammable synapses, local logic and memory. Local logic is based
on memristor computations using material implication. Only 15 is described and simulation results are shown.
CMOS transistors per cell are used, independent of the size of
II. M EMRISTOR M ODEL WITH P ROGRAMMING
the neighborhood, since memristors are used as synapses. Also,
space-dependent templates (weight matrices) are possible at no T HRESHOLD
extra hardware cost. The operation of the cell is described and The memristor reported in [4] was programmed linearly by
simulation results are shown to illustrate the operation. passing charge through the device. However, the resistance of
the memristor reported in [6] exhibits a nonlinear dependence
I. I NTRODUCTION
on the voltage over the memristor. The latter device is of
Cellular architectures are usually seen to be well especial interest here because the nonlinearity allows a specific
suited for nanoscale technologies because of their regu- programming threshold [9], i.e., the devices can be operated
lar, locally connected network topology. The cellular neu- either in programming or readout mode depending on the volt-
ral/nonlinear/nanoscale network (CNN) theory [1] is a age over the device. Many memristor SPICE models without
paradigm that describes dynamics of processing cells based the programming threshold exist, e.g., [10]. In this paper a
on local interaction. The interaction between cells is pro- SPICE model introduced in [7], based on the experimental
grammable via weight matrices (templates) that can be pro- data and model of [6] is used. In the model of [7], the current
grammed on the fly allowing sequences of neighbor operations through the memristor is
to be run successively, while intermediate results can be stored
I = wn β sinh(αV ) + χ(exp(γV ) − 1). (1)
in local memories [2].
The memristor, invented by Chua in 1971 [3], is a nanoscale Here w is the state variable of the memristor [4] and the
resistive memory, the resistance (memristance) of which can constants α,β,χ and γ depend on the physical properties of
be programmed by passing charge through the device. In order the component. The time derivative of the state variable w is
for the memristance effect to be significant, the device has modeled as
dw
to be fabricated in nanoscale. While many groups have run = a · f (w) · V q , (2)
into the memristance effect in their experiments, HP Labs was dt
the first to identify their titanium oxide- based device as a where a is a constant, f : [0, 1] → R is a window function [4]
memristor [4].
f (w) = 1 − (2w − 1)2p (3)
The memristor can be constructed in a crossbar formation
allowing very dense programmable wiring fabrics. These are of where p is a positive integer. The state derivative depends
great interest in terms of building compact large neighborhood on the q’th power of V , making a proper programming
CNNs, especially since memristors can be processed on top threshold for large values of q. In the simulations of this
of CMOS circuits (CMOS/nanomemristor hybrids) [5]. The paper n was 4 and q was 13. A large q is needed in order to
memristor can be programmed to multiple resistive states [6], model the highly nonlinear dependency of the oxygen vacancy
and such a CNN was proposed [7], but programming the drift velocity on the applied voltage. More details of the
device into two states (ON, OFF state) can be done with much model and parameters can be found from [7]. Figure 1 shows
simpler hardware for controlling the programming. In [8] it Eldo simulations (Eldo is a commercial variant of SPICE) of
was shown that the ON-OFF programmability is sufficient for the memristor model. The top left subfigure shows voltage
performing CNN operations with binary inputs/outputs. over the memristor, the top right subfigure shows the current
In this paper, an ON-OFF programmable CNN with memris- through the memristor whereas the bottom left subfigure shows
tors acting as synapses, local logic and memory is studied. This the state variable w. It can be observed that small voltages
paper is organized so that first, a modified SPICE model of over the memristor do not affect w which demonstrates the
a memristor used in the simulations is described, and benefits existence of a proper programming threshold. The bottom
right subfigure shows the current-voltage characteristics of a programming is interrupted and m2 ends up in an intermediate
memristor showing a proper signature of a memristive device. state between ON/OFF states. In [11] it was assumed that pro-
It should be emphasized that, even thought the model is based gramming was instantaneous making the problem nonexistent.
on the experimental data of [6] it is not aiming to be an Here a keeper circuit, shown in Section IV, is used in parallel
accurate physical model (there is not enough data available to RO to guarantee a complete programming.
to do that); the model is aiming at reproducing the general
characteristics/behavior of a memristor. Also, it should be Vcond Vset
noted that here the state variable w is hard limited between
m1 m2
0.05 and 0.95. This avoids the problems in the extremes of w
described in [10].
m1 m2 m2 = m1 → m2
−6
RO
2 2
x 10 0 0 1
0 1 1
1
1
1 0 0
0
Imem
1 1 1
Vin
0
−1
−1
Figure 2. Implication logic with memristors.
−2
−2 −3
0 1 2 3 0 1 2 3
Time −7
x 10 Time −7
x 10 B. Multi-Input NOR Using Implication
−6
x 10
1
1
The implication operation of Figure 2 can be extended
0.8 to multiple memristors. This opens up a possibility to use
0.6 0 memristors as synapses of a CNN. Figure 3 shows how
Imem
w
0.4
multi-input, programmable NOR operation can be computed
−1
0.2
with memristors. Memristor m4 is first initialized into a
−2 nonconducting state. Then, the result of the implication gives
0
0 1 2 3 −2 −1 0 1 2
Time −7
x 10 Vin
cell. Control voltages Vprog1 and Vprog2 define whether the VSS R_outi,j
memristors are turned ON or OFF. Here Vprog1 and Vprog2 R_ini,j KEEP
signals and M ASK and are active, voltage over all the Vprog1
Vprog2 C_outi,j
neighbor connection memristors is Vprog1 − Vprog2 . This way, VSS
all neighborhood connections can be turned either ON or OFF keeper
simultaneously.
If weights are to be programmed individually, it has to Figure 4. Structure of an ON-OFF programmable CNN cell using memristors.
be done by conducting a procedure depicted in Figure 5.
Rin Cin
It shows how different activation patterns are produced with Rout Cout Weight N
−2
0 0.2 0.4 0.6 0.8 1
Time x 10
−6 thing is that the neighborhood can be increased without adding
1 CMOS transistors (but again template programming time is
wsfb increased). A major benefit is that only 15 CMOS transis-
wwm1
tors/cell are needed, making very dense arrays possible. Also,
0.5 wwm4
space-dependent templates are available for use. Therefore,
the proposed cell is suited for applications that require large
0
0 0.2 0.4 0.6 0.8 1
neighborhoods and/or space dependent templates but in which
Time x 10
−6
the templates do not need to be programmed very fast.
Figure 6. Processing sequence: self-feedback memristor mSF B is pro- ACKNOWLEDGMENTS
grammed conducting.
This work was funded by the Academy of Finland (131295),
Geta graduate school and Nokia Foundation.
Figure 7 shows the same simulation with the difference
that mSF B is left into OFF state. Therefore, state node X R EFERENCES
cannot be pulled HI through mSF B and the weak pulldown [1] L.O.Chua, L.Yang, “Cellular Neural Networks: Theory”, IEEE Trans-
path (transistor biased with Vbias1 ) pulls the state X to a LO actions on Circuits and Systems-I, vol.35, no.10, pp.1257–1272, Oct.
voltage. After that, the keeper is activated and locks node X 1988.
[2] T. Roska and L. O. Chua "The CNN universal machine: an analogic
to the LO voltage. Therefore, the implication operation brings array computer", IEEE Trans, on Circuits and. Systems II, Vol. 40, pp.
m1 into a conducting state as can be observed from the simu- 163-173,1993.
lation. Therefore, the simulation successfully demonstrates the [3] L. O. Chua, “Memristor - The Missing Circuit Element”, IEEE Trans-
actions on Circuit Theory, vol. 18, no. 5, pp. 507-519, 1971.
capability of the cell to perform implication operations on a [4] D. Strukov, et al., “The Missing Memristor Found”, Nature, vlo. 453,
programmable neighborhood. pp. 80-83, May 2008.
The above example is a sequence of processing a B- [5] K. Likharev, “CMOL: possible hybrid semiconductor/nanodevice cir-
cuits”, Proceedings of the 2005 European Conference on Circuit Theory
template (nonpropagating neighborhood logic operation). An and Design, 2005. Vol 2, pp. II/237, 2005.
A-template (asynchronously propagating neighborhood logic [6] J. Yang, et al., “Memristive Switching mechamism for metal/oxide/metal
operation) can be run so that control signal AB is kept HI nanodevices”, Nature Nanotechnology, Vol. 3, July 2008.
[7] E. Lehtonen, M. Laiho, “CNN Using Memristors for Neighborhood
during the transient and implication of the result is carried out Connections”, accepted to IEEE Cellular Nanoscale Networks and their
after the transient has settled. Applications, 2010.
[8] M. Laiho, A. Paasio, J. Flak, K. Halonen, “Template Design for Cellular
V. C ONCLUSIONS Nonlinear Networks With 1-Bit Weights”, IEEE Trans. Circuits and
Systems I, Vol 55, No. 3, pp. 904-913, 2008.
CMOS/memristor hybrids are not currently commercially [9] p. Vontobel., et al., “Writing and reading from a nano-scale crossbar
memory based on memristors”, Nanotechnology, 2009.
available. There are issues such as the number of write cycles, [10] Z. Biolek, D. Biolek, V. Biolkova, “SPICE Model of Memristor with
writing speed, and mismatch/defects, that need to be improved. Nonlinear Dopant Drift”, 2009.
However, memristors bear a promise of very high memory [11] P. Kuekes, “Material Implication: Digital Logic with Memristors”,
Memristor and Memristive Systems Symposium, UC Berkeley, 2008.
density and wiring fabrics (that take no silicon area in CMOS [12] E. Lehtonen, M. Laiho, “Stateful Implication Logic with Memristors”,
hybrids) making their development worth the while. This paper Proc. of Nanoarch, San Francisco, 2009.
demonstrates the use of memristors for constructing an ON- [13] Ö. Turel, et al., “Neuromorphic Architectures for Nanoelectronic Cir-
cuits”, International Journal of Circuit Theory and Applications”, Vol.,
OFF programmable CNN. The downside of the approach is 32, pp. 277-302, 2004.
that programming of the templates becomes slower. The good