Professional Documents
Culture Documents
This is the author's version which has not been fully edited and
content may change prior to final publication. Citation information: DOI 10.1109/TCSII.2023.3324584
Abstract—In large-scale neuromorphic systems, a spiking neu- the standard current-mode log-domain circuit [9] by enabling
ral network (SNN) provides a promising solution for energy- control of circuit gain through an additional independent
efficient computing. Optimizing SNN building blocks like neurons bias voltage. However, high supply voltage and short-circuit
and synapses can further enhance computing efficiency. Due to
their simplicity and computational efficiency, integrate-and-fire currents flowing through the inverters during the switching
neuron (I&F) models are widely used in SNNs. In the past time cause significant power consumption. Several neuron
proposals of I&F neuron models, the main issue is the short- circuits [10][11] have recently been implemented using the
circuit currents in CMOS inverters, which significantly inhibit FDSOI process. This choice is driven by the ultra-low leakage
the circuit’s optimal performance and energy efficiency. This currents offered by the FDSOI process, despite it not being
paper presents an energy-efficient differential-pair integrator
(DPI) based I&F silicon neuron (SiN) circuit by utilizing the cost-effective to produce biologically plausible dynamics with
subthreshold source-coupled logic (STSCL) circuit topology as a time constants in the order of seconds. In recent years, research
replacement for CMOS inverters and incorporating a low supply on emerging stochastic artificial neurons (SANs) [12]-[16] has
voltage to mitigate leakage currents effectively. The proposed SiN surged due to their simpler circuits, inherent randomness, and
is implemented in 65 nm CMOS technology with a supply voltage smaller size compared to CMOS neurons. While SANs can
of 0.5-V and has an energy consumption of 3.6 pJ/spike with a
spiking frequency (rate) of 30 Hz. replicate basic functions like firing, refractory periods, tunable
output frequencies, and frequency adaptation, they cannot
Index Terms—After-hyperpolarization (AHP), differential-pair mimic advanced features of biological neurons, such as lateral
integrator (DPI), integrate-and-fire neuron, silicon neuron, spik-
ing neural network, subthreshold source-coupled logic. inhibition, variable spiking modes, and chaos [17]. CMOS
neurons are cost-effective and mimic the advanced features of
biological neurons, however, the deployment of subthreshold
I. I NTRODUCTION CMOS inverters as reported in [7][8], causes a brief period
Authorized licensed use limited to: Indian Institute of Technology - BHUBANESWAR. Downloaded on February 06,2024 at 10:23:56 UTC from IEEE Xplore. Restrictions apply.
© 2023 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission.See https://www.ieee.org/publications/rights/index.html for more information.
This article has been accepted for publication in IEEE Transactions on Circuits and Systems--II: Express Briefs. This is the author's version which has not been fully edited and
content may change prior to final publication. Citation information: DOI 10.1109/TCSII.2023.3324584
voltage) FETs have been preferred due to their low subthresh- From the EKV model [19], the subthreshold pMOS device
old leakage currents for the applied gate-to-source voltage, as I–V characteristics are given by
illustrated in Fig. 1 to get the required low currents. V
VBG −VT 0 SB VDB
ISD = I0 · e np UT
e UT − e UT (1)
A. Neuron circuit simulation results by the proposed neuron circuit for a Vth of 230 mV is shown
Isyn from Fig. 3 represents the presynaptic currents re- in Fig. 4b along with the spiking period of Vmem variation
ceived by the neuron’s dendrites. The input DPI integrates with Vth is shown in Fig. 5a. The spike-frequency adaptation
the received currents and the current provided by the AHP behaviour obtained by appropriately adjusting the parameters
mechanism leading to an increase in the membrane voltage of the AHP block of Fig. 3 and the neuron’s response to
(Vmem ). the constant injected current are demonstrated in Fig. 5b.
Z Vth Z t The after-hyperpolarization voltage (Vahp ) increases with each
Cmem dVmem = (Isyn − Iahp ) dt (8) spike, reducing the overall current that charges Cmem . Once
0 0 the Vahp attains a stable state, the spiking frequency of the
As Vmem approaches the switching threshold Vth of the neuron stays constant to a lower value than its initial value.
STSCL circuit, the voltage of the output node VN decreases, The neuron’s response to a step input for various settings
leading to an increase in the current If b through MN 6 and of the parameters such as Vbn na , Vbp na , Vack and Vgain
MN 8 . This, in turn, causes a sharp rise in Vmem , contributing illustrated in Fig. 6. The increase in Vbn na increases Iss ,
to the spike generation mechanism. During the spike genera- reducing both the delay in the STSCL gate and the node
tion time the Cmem charges with a current of Isyn −Iahp +If b . voltage VN . This reduction in VN leads to increased currents
Immediately after the spike is generated, the decrease in node If b and Ireset , ultimately resulting in higher charging and
VN voltage starts to increase the current Ic flowing through discharging rates of the Cmem . As a result, the spiking rate
the MK2 , consequently charging the capacitor Cr . As the of the neuron increases, as illustrated in Fig. 6a. As the
capacitor attains a sufficiently high voltage, Ireset initiates an Vbp na increases, it induces a decrease in the voltage VN .
increase and pulls Vmem down to zero, thereby establishing Consequently, the neuron’s maximum spiking rate increases,
the reset mechanism. During the spike reset mechanism the shown in Fig. 6b. Increasing the parameter Vack decreases
Cmem discharges with a current of Isyn − Iahp + If b − Ireset . the current responsible for charging Cr , leading to a slow-
The transistor sizes are adjusted in order to ensure that Ireset down reset mechanism. As a result, the neuron’s spiking rate
has the capability to pull Vmem to zero. The Vmem generated decreases, shown in Fig. 6c. As expected, increasing Vgain
Authorized licensed use limited to: Indian Institute of Technology - BHUBANESWAR. Downloaded on February 06,2024 at 10:23:56 UTC from IEEE Xplore. Restrictions apply.
© 2023 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission.See https://www.ieee.org/publications/rights/index.html for more information.
This article has been accepted for publication in IEEE Transactions on Circuits and Systems--II: Express Briefs. This is the author's version which has not been fully edited and
content may change prior to final publication. Citation information: DOI 10.1109/TCSII.2023.3324584
(a) (b)
currents through STSCL topology and mitigating leakage
currents with low supply voltage.
C. Impact of non-idealities
In order to evaluate the impact of the non-idealities on
the proposed design, Monte Carlo simulations have been
performed to evaluate the device mismatches and PVT anal-
yses have been performed to evaluate the effect of process,
temperature, and supply variations on the spiking rate of the
neuron. Monte Carlo analysis has been performed for the
neuron circuit with a sample count of 500, injecting DC
(c) (d)
current (Isyn ) into the LEAK block through ML1 , as shown
Fig. 6. Spiking rate versus input current for different values of (a) Vbn na , in Fig. 3. Moreover, the bias currents were adjusted to attain a
(b) Vbp na , (c) Vack , and (d) Vgain .
spiking rate of 120 Hz while activating the AHP circuit. The
Monte Corlo results with mean is around the desired value
reduces the Igain so the most of Iin flow into the Cmem
(≈120 Hz) with a standard deviation of 39.36 Hz as shown
which eventually reduces the integration time and increases
in Fig. 8a. The deviation in the spiking rate is due to the
the neuron’s spiking rate shown in Fig. 6d.
subthreshold operation of the transistors.
The process corner simulations have been performed to
B. Energy per spike observe the influence of process corner variation on the spiking
The energy consumed per spike (Es ) is an essential figure rate of the proposed neuron. The proposed neuron can produce
of merit (FoM) for neuron circuits to implement massively the spiking in all the process corners for the corresponding
parallel large-scale neuromorphic processors. It is given by input stimulus current (Isyn ) with some variation in the spiking
rate. The variation in spiking rate with corresponding input
Pavg
Es = (9) stimulus current at different corners is shown in Fig. 8b.
fspike The effect of temperature and supply voltage variation
where Pavg is the average power consumption of the neuron on the spiking rate of the proposed neuron is observed by
and fspike is the spiking frequency. The proposed neuron adjusting bias currents to attain a stable spiking rate of 120
circuit’s simulated Es corresponds to the spiking rate shown Hz at 25◦ C and at a supply voltage of 0.5 V. Then the change
in Fig. 7. in spiking rate is observed by varying the temperature from
The proposed neuron’s Es compared with the previous -10◦ C to 70◦ C and the simulated results is shown in Fig. 9a.
works in Table II. The proposed neuron circuit achieved better The change in spiking rate with supply variation from 450
Es compared to previous works by eliminating short circuit mV to 550 mV is shown in Fig. 9b. The variation in the
TABLE II
P ERFORMANCE COMPARISON OF PROPOSED NEURON WITH PREVIOUS WORKS
Authorized licensed use limited to: Indian Institute of Technology - BHUBANESWAR. Downloaded on February 06,2024 at 10:23:56 UTC from IEEE Xplore. Restrictions apply.
© 2023 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission.See https://www.ieee.org/publications/rights/index.html for more information.
This article has been accepted for publication in IEEE Transactions on Circuits and Systems--II: Express Briefs. This is the author's version which has not been fully edited and
content may change prior to final publication. Citation information: DOI 10.1109/TCSII.2023.3324584
R EFERENCES
[1] M. Davies et al., “Loihi: A Neuromorphic Manycore Processor with
On-Chip Learning,” in IEEE Micro, vol. 38, no. 1, pp. 82-99, Jan-
uary/February 2018.
[2] W. Maass, “Networks of spiking neurons: The third generation of neural
network models,” Neural Netw., vol. 10, no. 9, pp. 1659–1671, 1997.
[3] M. Mahowald and R. Douglas, “A silicon neuron,” Nature, vol. 354, pp.
515–518, 1991.
[4] M. F. Simoni, G. S. Cymbalyuk, M. E. Sorensen, R. L. Calabrese and
S. P. DeWeerth, “A multiconductance silicon neuron with biologically
matched dynamics,” in IEEE Transactions on Biomedical Engineering,
vol. 51, no. 2, pp. 342-354, Feb. 2004.
[5] S. Moradi, N. Qiao, F. Stefanini and G. Indiveri, “A Scalable Multicore
(a) (b) Architecture With Heterogeneous Memory Structures for Dynamic Neu-
Fig. 8. (a) Monte Carlo results for the distribution of the spiking rate of romorphic Asynchronous Processors (DYNAPs),” in IEEE Transactions
proposed neuron circuit and (b) Spiking rate versus input current at different on Biomedical Circuits and Systems, vol. 12, no. 1, pp. 106-122, Feb.
process corners. 2018.
[6] C. Mayr et al., “A Biological-Realtime Neuromorphic System in 28
nm CMOS Using Low-Leakage Switched Capacitor Circuits,” in IEEE
spiking rate of the proposed neuron is because the leakage Transactions on Biomedical Circuits and Systems, vol. 10, no. 1, pp.
currents of subthreshold transistors depend exponentially on 243-254, Feb. 2016.
both temperature and supply voltage [20] [21]. [7] G. Indiveri, E. Chicca and R. Douglas, “A VLSI array of low-power spik-
ing neurons and bistable synapses with spike-timing dependent plasticity,”
in IEEE Transactions on Neural Networks, vol. 17, no. 1, pp. 211-221,
Jan. 2006.
[8] P. Livi and G. Indiveri, “A current-mode conductance-based silicon
neuron for address-event neuromorphic systems,” 2009 IEEE International
Symposium on Circuits and Systems, Taipei, Taiwan, 2009, pp. 2898-
2901.
[9] D. R. Frey, “Log-domain filtering: An approach to current-mode filtering,”
IEE Proceedings G: Circuits, Devices and Systems, vol. 140, no. 6, pp.
406–416, December 1993.
[10] A. Rubino, C. Livanelioglu, N. Qiao, M. Payvand and G. Indiveri,
“Ultra-Low-Power FDSOI Neural Circuits for Extreme-Edge Neuromor-
phic Intelligence,” in IEEE Transactions on Circuits and Systems I:
Regular Papers, vol. 68, no. 1, pp. 45-56, Jan. 2021.
(a) (b) [11] H. Eslahi, T. J. Hamilton and S. Khandelwal, “Compact and Energy
Fig. 9. Spiking rate with (a) temperature variation and (b) supply variation. Efficient Neuron With Tunable Spiking Frequency in 22-nm FDSOI,” in
IEEE Transactions on Nanotechnology, vol. 21, pp. 189-195, 2022.
[12] Lu, Yi-Fan and Li, Yi and Li, Haoyang and Wan, Tian-Qing and Huang,
D. Layout Xiaodi and He, Yu-Hui and Miao, Xiangshui, “Low-Power Artificial
Neurons Based on Ag/TiN/HfAlOx/Pt Threshold Switching Memristor
The layout of the proposed neuron circuit is shown in Fig. for Neuromorphic Computing,” in IEEE Electron Device Letters, vol. 41,
10. The layout of the neuron circuit, including the bias circuit, no. 8, pp. 1245-1248, Aug. 2020.
occupies an active area of 55 × 37 µm2 . [13] Dutta Sourav, Schafer Clemens, Gomez Jorge, Ni Kai, Joshi Siddharth,
Datta Suman, “Supervised Learning in All FeFET-Based Spiking Neural
Network: Opportunities and Challenges,” Frontiers in Neuroscience, vol.
41, 2020.
[14] Kurenkov, Aleksandr and DuttaGupta, Samik and Zhang, Chaoliang and
Fukami, Shunsuke and Horio, Yoshihiko and Ohno, Hideo, “Artificial
Neuron and Synapse Realized in an Antiferromagnet/Ferromagnet Het-
erostructure Using Dynamics of Spin–Orbit Torque Switching,” Advanced
Materials, vol. 31, April 2019.
[15] Tuma, Tomas and Pantazi, Angeliki and Gallo, Manuel and Sebastian,
Abu and Eleftheriou, Evangelos, “Stochastic phase-change neurons,”
Nature Nanotechnology, vol. 11, May 2016.
[16] Yi, Wei and Tsang, Kenneth and Lam, Stephen and Bai, Xiwei and
Crowell, Jack and Flores, Elias, “Biological plausibility and stochasticity
in scalable VO2 active memristor neurons,” Nature Communications, vol.
9, November 2018.
Fig. 10. Layout of the proposed neuron circuit, including the bias circuit. [17] Li, Zong-xiao and Geng, Xiao-ying and Wang, Jingrui and Zhuge,
Fei, “Emerging Artificial Neuron Devices for Probabilistic Computing,”
Frontiers in Neuroscience, vol. 15, 2021.
IV. C ONCLUSIONS [18] A. Tajalli, E. J. Brauer, Y. Leblebici and E. Vittoz, “Subthreshold Source-
Coupled Logic Circuits for Ultra-Low-Power Applications,” in IEEE
This work presented an energy-efficient STSCL-based in- Journal of Solid-State Circuits, vol. 43, no. 7, pp. 1699-1710, July 2008.
tegrate and fire neuron circuit topology implemented in 0.5- [19] C. Enz and E. Vittoz, Charge-Based MOS Transistor Modeling: The
V, 65 nm CMOS with a refractory period, spike frequency EKV Model for Low-Power and RF IC Design. New York: Wiley, 2006.
[20] Sourikopoulos, Ilias and Hedayat, Sara and Loyez, Christophe and
adaptation, spiking frequency modulation mechanisms. The Danneville, François and Hoel, Virginie and Mercier, Eric and Cappy,
proposed neuron produces biologically feasible neural dynam- Alain, “A 4-fJ/Spike Artificial Neuron in 65 nm CMOS Technology,”
ics by matching the time constants to those observed in natural Frontiers in Neuroscience, vol. 11, 2017.
[21] L. Zhang, J. Zhang, Y. Wang, X. Zhang and R. Huang, “A Multi-Mode
signals like speech. Therefore, the proposed neuron topology is Silicon Neuron Circuit With High Robustness Against PVT Variation,”
a good candidate for deployment in large-scale neuromorphic 2018 IEEE International Symposium on Circuits and Systems (ISCAS),
systems for energy-efficient computing. pp. 1-4, 2018.
Authorized licensed use limited to: Indian Institute of Technology - BHUBANESWAR. Downloaded on February 06,2024 at 10:23:56 UTC from IEEE Xplore. Restrictions apply.
© 2023 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission.See https://www.ieee.org/publications/rights/index.html for more information.