Professional Documents
Culture Documents
fully edited. Content may change prior to final publication. Citation information: DOI 10.1109/JSEN.2021.3087333, IEEE Sensors
Journal
IEEE SENSORS JOURNAL, VOL. XX, NO. XX, XXXX 2017 1
Abstract— Monitoring of pH is crucial for several chemical and biochemical processes. ISFET (Ion-Sensitive Field-Effect
Transistors)-based pH sensors are promising candidates for pH monitoring applications. However, ISFET devices are
prone to temporal and temperature drifts, which severely affects the precision of pH measurements. In this work, we
collect experimental data of temporal and temperature drifts in an ISFET sensor to formulate an accurate SPICE macro
model, incorporating both temporal and temperature non-idealities. The developed macro model is utilized for generating
training data for state-of-the-art machine learning models for drift compensation, with a primary focus on the temporal
characteristics. We utilize recurrent neural networks (RNNs) to model the temporal characteristics of ISFET, and thus,
compensate the non-ideality. The sensor data is collected in various pH buffer solutions and a data set of sequences
containing time-dependent voltage readings are generated by the device and the RNNs are trained to learn the crucial
features from the data and map them to the precise pH of the solution. We compare two variants of RNNs, i.e. LSTM
(long short-term memory) and GRU (gated recurrent unit), and their bidirectional low computational cost variants -
biLSTM and biGRU. Each model is tested in a memory-constrained environment with the availability of a 32-bit and 64-bit
floating-point number. Empirically, we find biLSTMs to perform best, where the achieved root mean square error (RMSE)
between the model predicted pH and the true pH of the test solution is less than 0.212 pH, with an average RMSE of 0.126
pH. For temperature drift compensation, we collect data for four different temperatures and adapt well-established MLPs
(Multi-layer Perceptrons) to compensate the intrinsic temperature drift in the sensor. We observe an average RMSE of
the model predicted pH to the true pH to be less than 0.286 pH. The developed RNN models were implemented on Xilinx
ZCU104 FPGA development kit using PYNQ framework, which demonstrates low power consumption. The proposed
framework establishes the efficacy of Machine Learning (ML) techniques for drift compensation in ISFET-based pH
sensors for deployment in IoT applications.
Index Terms— ISFET, SPICE, machine learning, artificial neural networks, recurrent neural networks, IoT.
1530-437X (c) 2021 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
Authorized licensed use limited to: BOURNEMOUTH UNIVERSITY. Downloaded on July 04,2021 at 08:08:47 UTC from IEEE Xplore. Restrictions apply.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI 10.1109/JSEN.2021.3087333, IEEE Sensors
Journal
2 IEEE SENSORS JOURNAL, VOL. XX, NO. XX, XXXX 2017
4 Circuit-Board
Real-time environmental monitoring
systems in harsh climate
Time and temperature
drift compensation using
machine learning
Health Monitoring Systems
1
SPICE model
Development Implementing ML algoorithms
on FPGA/ MCU hardware for
2 final System-On-Chip(SoC)
ISFET smart sensor
Nuclear, Chemical and Biological
(NBC) Warfare Denfense System for
Experiments extreme hot and cold environment
with ISFET device
Fig. 1: Overview of the ISFET smart sensor development process and its applications in IoT systems.
outputs, hence the task is to closely determine a function that RNN models on Xilinx ZCU104 FPGA development kit
maps its input to the desired output. Specific to our task of drift using PYNQ framework for sensor drift compensation.
compensation, we use recurrent neural networks (RNNs) and 3) We have developed a robust SPICE macro model of
multi-layer perceptrons (MLPs) for modeling temporal and ISFET pH sensor using experimentally extracted para-
temperature drift characteristics, respectively. RNNs belong to meters for temporal and temperature drift characteristics.
a class of neural networks that aims to model the relationship We use regression analysis to model the ISFET threshold
between sequence input to single or sequence output [18]. voltage as a function of time, temperature, and pH for
MLP is one of the simplest classes of feed-forward neural developing an accurate SPICE model.
networks [16]. ML techniques have become a popular tool The rest of the paper is organized as follows: Section II dis-
to make sensors robust against non-idealities [19]–[21]. Early cusses the ISFET background theory and data collection meth-
works on ML-based ISFET temperature drift modeling and odology. Section III elucidates the method of ISFET SPICE
compensation were presented by Bhardwaj et al. [19], [20] and macro model development using the regression technique.
Mehta et al. [22], which compared performances of different Section IV presents the temporal drift compensation model
ML models. Sinha et al. proposed the first model for ISFET development and Section V discusses the temperature drift
temporal drift compensation using an ML technique called compensation using MLP model. Section VI elucidates the
Bayesian inference [21]. While ML-based temperature drift FPGA implementation of developed RNN models for sensor
compensation has been well explored, no existing work has drift compensation. We present the results and discussion in
studied the relevance of Artificial Neural Networks (ANNs) Section VII and finally conclude with Section VIII.
for ISFET temporal drift compensation. Thus, we focus our
work on temporal drift modeling and provide an RNN-based II. E XPERIMENTAL M ETHODOLOGY FOR ISFET S ENSOR
framework to model inputs as a sequence. As compared to DATA C OLLECTION
[21], we do not assume any prior over the temporal charac-
teristics of the device. A. ISFET Theory and Operation
In this work, we propose a 4-step procedure towards smart ISFET is a FET-based chemical sensor popularly used for
ISFET pH sensor development for IoT applications. The first pH sensing applications. In an ISFET, the gate electrode is
stage involves the process of data collection. The second absent and the gate region is left exposed during device
stage involves ISFET macro model development in SPICE packaging to allow interaction of gate oxide with analyte
based on experimental device characteristics, which is used to solutions. The gate oxide is stacked with a sensing film such as
perform SPICE simulations to generate pH-Vref characteristics Al2 O3 , Si3 N4 , TiO2 etc., to obtain better sensing performance
of ISFET. The third stage is dedicated to ML techniques [23], [24]. The threshold voltage of the device is sensitive to
that aim to compensate for temporal and temperature drift in pH of analyte solution [25]. Fig. 2 shows the schematic of
sensor output. The fourth and final stage proposes methods to ISFET pH sensors at device and circuit levels. For an ISFET
implement the ML models on FPGA board to obtain a portable device operated in linear region, the drain current is given by
ISFET smart sensor for deployment in IoT applications. The [26]:
overall smart sensor development process is shown in Fig. 1. W VDS
The major contributions of this study are: IDS = µn Cox [(VGS − VT (ISF ET ) ) − ]VDS (1)
L 2
1) We report for the first time the development of RNN where, µn is the mobility of electron; W and L are the channel
models, viz., LSTMs, GRUs, biLSTMs, and biGRUs for width and channel length, respectively; Cox represents oxide
temporal drift compensation. For temperature drift com- capacitance per unit area; VT (ISF ET ) represents the ISFET
pensation, we implement feed-forward MLP models. threshold voltage; VGS is the difference between the gate and
2) We also report for the first time the implementation of source voltage; and VDS is the difference between drain and
1530-437X (c) 2021 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
Authorized licensed use limited to: BOURNEMOUTH UNIVERSITY. Downloaded on July 04,2021 at 08:08:47 UTC from IEEE Xplore. Restrictions apply.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI 10.1109/JSEN.2021.3087333, IEEE Sensors
Journal
AUTHOR et al.: PREPARATION OF PAPERS FOR IEEE TRANSACTIONS AND JOURNALS (FEBRUARY 2017) 3
B. Experimental Setup
A. SPICE Macro Model
A commercial Al2 O3 ISFET device (Micropto® , Italy) was
used for experiments with whose device dimensions are gate The methodology for the development of ISFET macro
width = 700 µm and gate length = 20 µm. Ag/AgCl reference model is different from previous studies, in terms of the
electrode (Metrohm® ) was used during sensor characterization modeling of ISFET threshold voltage [20], [21], [27]. There
and testing. The pH buffer solutions were purchased from are 5 terminals of the macro model, i.e., pH, Drain, Src,
Merck® . Keysight® B2902A Source Measure Unit (SMU) was Ref, and Blk. The pH of the buffer solution is modeled as
used for measuring the electrical characteristics of the ISFET a potential source and the potential at the pH node denotes
device. Tarsons® SPINOTTM digital magnetic stirrer hotplate the pH of the buffer solution. The SPICE macro model has
was used to control the temperature of pH buffer solutions three important components [27]:
during measurements. The experimental setup is shown in the 1) A level 3 NMOS model for modeling the electronic stage
Supplementary article (Fig. S1). of the ISFET device [28].
2) A time dependent potential source for modeling the
temporal drift in the ISFET device.
Voltage buffer 3) A temperature and voltage dependent voltage source for
mode
modeling the electrochemical properties of the ISFET
pH buffer solution in and its temperature drift.
contact with the ISFET
sensing film and The theoretical background of temporal and temperature
reference electrode D
dependence of ISFET device has been presented by Sinha et al.
Ref ISFET
[27] and a brief description is included in the Supplementary
B 3.5 Kꭥ
Article (Section SI.B and SI.C, respectively). Fig. 4 shows the
S +
schematic of the developed SPICE macro model of ISFET.
5V
-
1530-437X (c) 2021 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
Authorized licensed use limited to: BOURNEMOUTH UNIVERSITY. Downloaded on July 04,2021 at 08:08:47 UTC from IEEE Xplore. Restrictions apply.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI 10.1109/JSEN.2021.3087333, IEEE Sensors
Journal
4 IEEE SENSORS JOURNAL, VOL. XX, NO. XX, XXXX 2017
1.5
VT(ISFET) (V)
VRef CGuoy CHelm
VSurface_Dipole VTemporal_Drift 1.4
VReference 1.3
VSource (S)
_electrode
(REF) VBulk (B) 1.2
VTemperature_Drift
1.1
Fig. 4: Schematic of the ISFET SPICE macro model. 1.0
18 23 28 33 38 43 48 53 58
Temperature (C)
1) Mathematical model and approximations: For a particular Fig. 5: V T(ISFET) extracted from experimental transfer charac-
temperature and pH, the change in reference electrode voltage teristics data using Constant Current (CC) method.
(or gate voltage) with time, t is given by:-
t
∆VG (t) = c × [1 − exp−( )β ] (2) 2) Threshold voltage, VT(ISFET) extraction: To model the
τ
V T(ISFET) in SPICE macro model, we need to incorporate its
where, τ represents the structural relaxation time constant, β dependence on pH and T, whose values are extracted from
is associated with the dispersive transport and c is a constant. the experimental data. The threshold voltage, V T(ISFET) was
By using Eq. 2 and the available experimental data set, we extracted from the transfer characteristics using the Constant
extract the three unknown parameters τ , β and c for pH 2, 4, Current (CC) method [29]. The transfer characteristics data set
7 and 10 at T = 30o C. was used for threshold voltage extraction. Twenty V T(ISFET)
2) Regression analysis based parameter extraction in MAT- values were extracted and their values have been plotted
LAB: The temporal drift data set was used for extracting the against their respective temperature and pH, as shown in Fig.
parameters in Eq. 2. The extraction was carried out with the 5.
help of the Curve Fitting Toolbox of MATLABTM . We used the
method of ‘Non Linear Least Squares’ with the ‘Trust Region’
algorithm for performing the regression analysis. The values
of extracted parameters along with their respective goodness
of fit parameter Adj. R2 is given in Table I.
3) Incorporating mathematical model and extracted paramet-
ers in SPICE macro model file: The time dependent potential
source based on Eq. 2 and the values of the extracted para-
meters τ , β, and c are included in the macro model file. It is
important to note that these parameters are specific to pH and
temperature, as listed in Table I. Fig. 6: Comparison of experimental ISFET threshold voltage
with values predicted by the best fit polynomial.
TABLE I: Temporal drift parameters for ISFET SPICE macro
model extracted from experimental data (at 30o C) 3) Regression analysis in MATLAB: The V T(ISFET) is depend-
pH
c (or) ∆ VG (∞) β τ
Adj. R2
ent on pH and temperature (refer to Supplementary Article
( in Volts) ( Unitless) (in hr.) Section SI.A) . Instead of using our previous approach to
2 -0.03101 0.9568 2.138 0.9963
4 -0.015 1.833 1.69 0.9959 model V T(ISFET) [27], we used regression analysis to simplify
7 -0.005254 3.02 1.237 0.9696 the equation, which establishes the dependence of V T(ISFET)
10 -0.02328 0.8963 0.5958 0.9981 on T and pH. The Curve Fitting Toolbox of MATLAB was
used for regression analysis, where we used Bisquare Robust
technique for this purpose. We used polynomial regression to
model experimentally extracted V T(ISFET) values and obtained
C. Modeling ISFET electrochemical properties and a very good Adjusted R-square value of 0.9912. The other
temperature drift Goodness of Fit (GoF) parameters for this polynomial are
The procedure for modeling of electrochemical properties R-square value of 0.9949, squared estimate of errors (SSE)
and temperature drift of ISFET have been explained in the of 0.003812 and RMSE of 0.01862. The best fit polynomial
following subsections: surface has been plotted against the experimental data points
1) Mathematical Model: The equation defining ISFET in Fig. 6.
threshold voltage consists of temperature dependent terms 4) Incorporating mathematical model and extracted paramet-
(refer to Supplementary Article Section SI.C ), which causes ers in SPICE macro model file: The mathematical expression
drift in the sensor characteristics with temperature variation. derived after regression analysis, which models the electro-
1530-437X (c) 2021 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
Authorized licensed use limited to: BOURNEMOUTH UNIVERSITY. Downloaded on July 04,2021 at 08:08:47 UTC from IEEE Xplore. Restrictions apply.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI 10.1109/JSEN.2021.3087333, IEEE Sensors
Journal
AUTHOR et al.: PREPARATION OF PAPERS FOR IEEE TRANSACTIONS AND JOURNALS (FEBRUARY 2017) 5
6.5
-4
4.0x10
pH 2 (sim) 6.4
3.5x10
-4 pH 2 (exp)
Temperature = 30 C
pH 4 (sim)
VRef (V)
15 C (sim)
pH 4 (exp) 6.3
-4 15 C (exp)
3.0x10 pH 7 (sim)
pH 7 (exp) 25 C (sim)
pH 10 (sim)
2.5x10
-4
pH 10 (exp)
6.2 25 C (exp)
pH 12 (sim) 35 C (sim)
IDS (A)
-4 pH 12 (exp)
2.0x10 6.1 35 C (exp)
45 C (sim)
-4
1.5x10 6.0
45 C (exp)
55 C (sim)
-4
1.0x10 55 C (exp)
5.9
5.0x10
-5 1 2 3 4 5 6 7 8 9 10 11
pH
0.0
0.0 0.4 0.8 1.2 1.6 2.0
VDS(V)
Fig. 9: Comparison of experimental(exp) and simulated(sim)
ISFET CVCC topology readout. The readings were taken at
Fig. 7: Comparison of experimental (exp) and simulated (sim) pH 2, 4, 7, 10 and at temperature 15o C, 25o C, 35o C, 45o C
ISFET output characteristics curve at pH 2, 4, 7, 10 and at and 55o C.
temperature 30o C.
1.5x10
-4
pH 2 (sim)
pH 2 (exp) 1.5x10
-4
pH 2 (sim)
pH 2 (exp) The macro model replicates the behavior of the ISFET device
pH 4 (sim) pH 4 (sim)
pH 4 (exp)
pH 7 (sim)
pH 4 (exp)
pH 7 (sim) to a good degree, which makes it suitable to test the perform-
IDS (A)
IDS (A)
1.0x10
-4 pH 7 (exp) 1.0x10
-4 pH 7 (exp)
pH 10 (sim)
pH 10 (exp)
pH 10 (sim)
pH 10 (exp) ance of machine learning algorithms on it.
-5 -5
5.0x10 5.0x10
0.0
0.6 0.9 1.2 1.5 1.8 2.1
0.0
0.6 0.9 1.2 1.5 1.8 2.1
IV. T EMPORAL D RIFT C OMPENSATION
VRef (V) VRef (V)
-4 (a) 23o C temperature -4 (b) 33o C temperature In this section, we introduce a novel methodology for
2.0x10 2.0x10
Temperature = 43 C
Vds= 0.5V
Temperature = 53
Vds = 0.5 V
temporal drift compensation in the device. First, we show
pH 2 (sim)
1.5x10
-4
pH 2 (sim)
pH 2 (exp)
pH 4 (sim)
1.5x10
-4
pH 2 (exp)
pH 4 (sim)
how we process the raw sensor data. Next, we provide
pH 4 (exp) pH 4 (exp)
pH 7 (sim) pH 7 (sim)
pH 7 (exp)
problem formulation and quality feature selection as a part
IDS (A)
IDS (A)
1.0x10
-4 pH 7 (exp) 1.0x10
-4
pH 10 (sim) pH 10 (sim)
pH 10 (exp) pH 10 (exp) of the methodology. Further, we describe the RNN models,
5.0x10
-5
5.0x10
-5
experimental setup, followed by results and discussion on the
0.0 0.0
suitability of considered RNNs.
0.6 0.9 1.2 1.5 1.8 2.1 0.6 0.9 1.2 1.5 1.8 2.1
VRef (V) VRef (V)
1530-437X (c) 2021 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
Authorized licensed use limited to: BOURNEMOUTH UNIVERSITY. Downloaded on July 04,2021 at 08:08:47 UTC from IEEE Xplore. Restrictions apply.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI 10.1109/JSEN.2021.3087333, IEEE Sensors
Journal
6 IEEE SENSORS JOURNAL, VOL. XX, NO. XX, XXXX 2017
1530-437X (c) 2021 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
Authorized licensed use limited to: BOURNEMOUTH UNIVERSITY. Downloaded on July 04,2021 at 08:08:47 UTC from IEEE Xplore. Restrictions apply.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI 10.1109/JSEN.2021.3087333, IEEE Sensors
Journal
AUTHOR et al.: PREPARATION OF PAPERS FOR IEEE TRANSACTIONS AND JOURNALS (FEBRUARY 2017) 7
Recurrent Neural Network (RNN) – RNNs are a class of v1 up to vt . We refer it as forward-RNN with the parameter
F B
NNs specialized for modeling sequence of data such as time set fW . The backward-RNN with the parameter set fW at the
series. In our case, the sequence is Vset . An RNN model right encodes information from vn up to vt and generates hB t
iterates over the time-steps of a sequence. Each step t takes in the backward direction. We concatenate hF B
t and ht vectors
a representation ht−1 of input vt−1 from previous step t − 1 and learn a transformation matrix fO to predict the output Vp
and generates hidden representation at step t, i.e., ht . The input .
sequence can be processed as follows: 3) GRU: Similar to LSTMs, gated recurrent unit (GRU)
aims to solve long-term dependencies with a lower number
of model parameters as compared to LSTMs. Unlike LSTMs,
ht = fW (ht−1 , vt ) (5) GRU does not possess a cell state and uses a hidden state
Vp = fO (hn ) (6) to carry the information forward. Thus, GRUs have only two
where, fW is the function with parameters W . fO is a function gates: 1) Reset gate; and 2) Update gate.
with parameters O that learns to map hidden representation at
time t to the output Vp . It is noteworthy that in our setting, we rt = σg (Wr [ht−1 , x] + br ) (reset gate)
are calculating output only for input at step t + n, i.e., vt+n . zt = σg (Wz [ht−1 , xt ] + bf ) (update gate)
RNNs are designed to encode the necessary information from
all the previous inputs vt , . . . , vt+n−1 , use current input vt+n , hˆt = φh (Wh [xt , rt ht−1 ] + bh )
and fuse them to make robust predictions. ht = (1 − zt ) ht−1 + zt (hˆt ) (hidden state)
All the models considered in this paper are RNN-based
where, {Wr , WZ , Wh } are a weight matrices; {br , bf , bh }
models. The models learn their parameters via optimization
are bias vectors; σg is a sigmoid function; φh is a hyperbolic
algorithms, learning from data, to approximate an underlying
tangent function.
function that maps input to the output.
4) BiGRU: As elaborated in Section IV-C.2, biLSTM is a
1) LSTM: As the length of the input sequence grows, stand-
bidirectional variant of standard unidirectional LSTM. Follow-
ard RNNs find it difficult to bridge the connection between in-
ing a similar analogy, a biGRU is a bidirectional extension of
put at step t and output y at step n, as (n−t) increases. Hence,
GRU.
RNNs suffer from long-term dependencies. Long Short Term
Memory networks (LSTMs) [30] are a special kind of RNN
D. Experimental Design
that are explicitly designed to solve the long-term dependency
issues by introducing gates. LSTMs possess memory known In this section, we first obtain a regression curve, i.e., a
as cell state, which keeps the information about the past. An function that maps Vp at T = 0 to pH value. The curve is
LSTM is comprised of 3 gates: 1) Input gate; 2) Forget gate; required to carry out the projection step discussed in Section
3) Output gate. The gates help regulate the flow of information. IV-B.3. Further, we show the methodology to train an RNN
for the prediction stage. The RNN will map Vref at time T
> 0 to Vref at time T = 0 for the same pH of the medium.
ft = σg (Wf [ht−1 , xt ] + bf ) (forget gate)
it = σg (Wi [ht−1 , xt ] + bi ) (input gate)
ot = σg (Wo [ht−1 , xt ] + bo ) (output gate)
ct = ft ct−1 + it σh (Wc [ht−1 , xt ] + bc )
(cell state at time t)
ht = ot σc (ct )
(hidden state at step t)
where, {Wf , Wt , Wo , Wc } are weight matrices; Fig. 13: Polynomial regression curve fitting. Green curve
{bf , bi , bo , bc } are bias vectors; σg is a sigmoid function; shows the curve fitted on the dotted points. The dataset
{σh , σc } are hyperbolic tangent functions. Alternatively, σc contains 9 samples, i.e., a set of (pH, Vp ) readings.
can also be defined as σc (x) = x [31]; is element-wise
product operation.
2) BiLSTM: Standard LSTMs are unidirectional, i.e., they
have access to the information from the past until current step
t. As an extension, bidirectional LSTMs (biLSTMs) utilize
information from the past as well as from the future. BiLSTMs
comprise of two unidirectional LSTMs, one encodes necessary
information from step 0 to step t, while another from step n to
step t (t ≤ n) in the backward direction. Separate hidden states
are calculated from both the networks and appended to predict
the output. As shown in Fig. 15, the unidirectional RNN at left Fig. 14: Xilinx ZCU104 FPGA board booted with PYNQ.
(such as LSTM) calculates hF t by encoding information from
1530-437X (c) 2021 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
Authorized licensed use limited to: BOURNEMOUTH UNIVERSITY. Downloaded on July 04,2021 at 08:08:47 UTC from IEEE Xplore. Restrictions apply.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI 10.1109/JSEN.2021.3087333, IEEE Sensors
Journal
8 IEEE SENSORS JOURNAL, VOL. XX, NO. XX, XXXX 2017
1530-437X (c) 2021 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
Authorized licensed use limited to: BOURNEMOUTH UNIVERSITY. Downloaded on July 04,2021 at 08:08:47 UTC from IEEE Xplore. Restrictions apply.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI 10.1109/JSEN.2021.3087333, IEEE Sensors
Journal
AUTHOR et al.: PREPARATION OF PAPERS FOR IEEE TRANSACTIONS AND JOURNALS (FEBRUARY 2017) 9
Fig. 15: The left figure shows a representative RNN-based model. Input to the model is Vref (vt ), natural logvt (ut ), and
t
time-stamp information pi := 10 . The output of RNN is 32-dimensional. The center figure shows a 3-dimensional t-SNE plot
of the data (best viewed in color). The right figure is its 2-dimensional t-SNE map. Each color dot represents the true pH value
of model input. We observe that dots with similar values are clustered together.
gru 0.142 0.083 0.001 0.654 0.001 0.654 0.220 0.301 0.130 0.002 0.570 0.002 0.570 0.250
bilstm 0.045 0.006 0.003 0.010 0.003 0.045 0.016 0.109 0.003 0.002 0.027 0.002 0.109 0.035
bigru 0.344 0.208 0.001 1.393 0.001 1.393 0.487 0.342 0.178 0.001 1.407 0.001 1.407 0.482
lstm 0.090 0.002 0.014 0.034 0.002 0.090 0.035 0.063 0.005 0.013 0.024 0.005 0.063 0.026
64-bit
gru 0.341 0.105 0.001 0.644 0.001 0.644 0.273 0.333 0.082 0.001 0.830 0.001 0.830 0.312
bilstm 0.057 0.007 0.003 0.044 0.003 0.057 0.028 0.041 0.003 0.008 0.020 0.003 0.041 0.018
bigru 0.374 0.230 0.001 1.093 0.001 1.093 0.425 0.325 0.227 0.001 0.981 0.001 0.981 0.383
1530-437X (c) 2021 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
Authorized licensed use limited to: BOURNEMOUTH UNIVERSITY. Downloaded on July 04,2021 at 08:08:47 UTC from IEEE Xplore. Restrictions apply.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI 10.1109/JSEN.2021.3087333, IEEE Sensors
Journal
10 IEEE SENSORS JOURNAL, VOL. XX, NO. XX, XXXX 2017
of the models make significant prediction errors for pH 10; this onboard network parameters can be accordingly fine-tuned.
can also be observed in Table II. We suspect this behavior The inference task’s average energy per inference (prediction)
is a result of a shift in device temporal characteristics, i.e., is shown in Table IV. The per-inference energy consumption
generic patterns learned from train data comprised of pH 2, 4, of GRU and LSTM algorithms are 57.76 mJ and 63.02 mJ,
and 7. All the models trained on samples from pH 2, 4, and respectively. Consider a scenario where the deployed IoT
10 are observed to perform well for test samples from pH 7 sensor is used once every 15 minutes for a day, the total
(MSE ≤ 0.036 pH2 ). energy consumed by the sensor will be approximately 6 J for
The temperature compensation results are shown in Table 96 inferences per day3 . The commercial batteries have energy
III. The iteration-wise loss for the temperature drift compens- capacity up to 20,000 Joules [36], which makes it feasible to
ation is shown in Figure 18. perform the RNN inference on a battery’s power for a long
time. This analysis proves the applicability of RNN’s for IoT
deployment on platforms like FPGA. Our results are in line
with reported studies [37]–[39] who have implemented similar
RNN models for low power IoT applications, such as image
and text processing on FPGA.
1530-437X (c) 2021 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
Authorized licensed use limited to: BOURNEMOUTH UNIVERSITY. Downloaded on July 04,2021 at 08:08:47 UTC from IEEE Xplore. Restrictions apply.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI 10.1109/JSEN.2021.3087333, IEEE Sensors
Journal
AUTHOR et al.: PREPARATION OF PAPERS FOR IEEE TRANSACTIONS AND JOURNALS (FEBRUARY 2017) 11
TABLE V: Comparison of our study with other ISFET based sensor development research works.
Temperature Temporal Major technology/tools
Ref. Target Application Additional features
compensation compensation used
Wearable, flexible,
Real time and non-invasive health
[40] 3 - InGaZno material system low cost and
care devices, sweat sensing in sports
disposable
Dual-mode sensing array ( Both optical Accurate, high
Biomedical and personal and chemical sensing mode), Correlated throughput pH
[5] - -
genome diagnostics double mode (CDS) readout circuit and sensing and
pipelined ADC low cost
Precision pH sensory
Programmable current mirror circuit and
Water quality/environmental function, long
[14] 3 3 MCU( TI MSP430 series) based
monitoring term monitoring and
ISFET sensory system
low power
Sequential Bias reconfiguration of ISFET and
Self reliable with
Generic applications for Machine Learning ( support vector
[41] - - the help of
data driven sensing devices regression and backpropagation
wireless android IoT
neural network)
BSS ( blind source separation) algorithm
Low power, low cost,
[42] Online water pollution monitoring - - to detect ion concentrations and
and small
MCU (TIMSP430 series)
Low computation, both
Relay driver circuit for water parameter
Arduino based smart photon and pH
[43] - - correction and automatic feeding system,
aquaponics system bi-direction
Arduino YUN MCU and Android
capabilities
MCU ( AVR ATMEGA-328 8 bit MCU), Low cost , low power
Huawei GSM900 module, SPI, and easy to
[44] In-situ water environment monitoring - -
mobile networks, Li-Ion batteries, PHP, implement
Mysql and Android( Mini SDK: API 8, OS 2.2) and expand
Dual gate ISFET(DG ISFET),
pH/light bi functional sensing device Low cost and
[45] - - sequential control method and
for generic IoT applications low power
Back Propagation Neural Network(BPNN)
2-stage sawtooth oscillator, TSMC 0.18 um
Portable, merges
M6 CMOS technology, pH to PWM readout
On-chip DNA amplification and chemical
circuit, ISFET based linear OTA (Operational
detection for Lab-on-a-Chip and temperature
[46] - 3 Transconductance Amplifier), on-chip R-2R
diagnostics Point of Care sensing in the
11-bit DAC, 24-bit slave SPI unit,
(PoC) diagnostics) same pixel,
FPGA development platform terasIC DE2i-150 and
Programmable
Keithley 2602 ( for controlling electrode potential)
IoT applications in long term Machine Learning- Recurrent Neural
Accurate,
environmental monitoring Networks (RNNs): BiLSTMs for temporal drift
Programable ,
This in a harsh climate, compensation and Artificial Neural Network(ANN)
3 3 functional in extreme
Work biomedical monitoring Multilayer perceptron regressor(MLP) for
conditions and low
and NBC warfare defense temperature drift compensation, CVCC readout
computational cost.
systems. circuit and MCU/FPGA based hardware.
for the device’s non-ideality. We observed that the MLP research work.
achieves the RMSE score of 0.286 pH. We also implemented
the RNN models on Xilinx ZCU104 FPGA development board
using the PYNQ framework and found that they consume very R EFERENCES
low energy, around 6 mJ per inference and are very suitable for
[1] N. Moser, J. Rodriguez-Manzano, T. S. Lande, and P. Georgiou, “A
IoT applications. Thus, the results show that low computation scalable isfet sensing and memory array with sensor auto-calibration
ML algorithms can be used to effectively compensate temporal for on-chip real-time dna detection,” IEEE transactions on biomedical
and temperature drift in ISFET pH sensors deployed in various circuits and systems, vol. 12, no. 2, pp. 390–401, 2018.
[2] V. Pachauri and S. Ingebrandt, “Biologically sensitive field-effect tran-
IoT applications. sistors: from isfets to nanofets,” Essays in biochemistry, vol. 60, no. 1,
pp. 81–90, 2016.
[3] M. J. Schöning and A. Poghossian, “Recent advances in biologically
ACKNOWLEDGMENT sensitive field-effect transistors (biofets),” Analyst, vol. 127, no. 9, pp.
1137–1151, 2002.
The authors are grateful to the Director, CSIR-CEERI, [4] J. Zeng, N. Miscourides, and P. Georgiou, “A 128× 128 current-
Pilani for his constant support and motivation to carry out mode ultra-high frame rate isfet array for ion imaging,” in 2018 IEEE
this work. They are thankful to all the scientific and technical International Symposium on Circuits and Systems (ISCAS). IEEE, 2018,
pp. 1–5.
staff members of the Semiconductor Devices Area for the [5] X. Huang, H. Yu, X. Liu, Y. Jiang, M. Yan, and D. Wu, “A dual-
discussions and technical support. They would like to thank mode large-arrayed cmos isfet sensor for accurate and high-throughput
Dr. T. Eshwar and Dr. Satyam Srivastava for providing support ph sensing in biomedical diagnosis,” IEEE Transactions on Biomedical
Engineering, vol. 62, no. 9, pp. 2224–2233, 2015.
to carry out the device measurements. The authors are also
[6] T. Hyodo, M. Yuto, H. Tanigawa, M. Tsuruoka, H. Sakamoto, T. Ueda,
thankful to Dr. Vinay Chamola for providing us the Xilinx K. Kamada, and Y. Shimizu, “Solid-state isfet-based sensors capable
ZCU104 FPGA Development Board and Mr. Anubhav Elhence of measuring acidity of lubricants,” ECS Transactions, vol. 98, no. 12,
for support in the implementation of RNN models on FPGA p. 59, 2020.
[7] N. Moser, T. S. Lande, C. Toumazou, and P. Georgiou, “Isfets in
board. They are grateful to CSIR, New Delhi for providing cmos and emergent trends in instrumentation: A review,” IEEE Sensors
the research facilities and financial support to carry out this Journal, vol. 16, no. 17, pp. 6496–6514, 2016.
1530-437X (c) 2021 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
Authorized licensed use limited to: BOURNEMOUTH UNIVERSITY. Downloaded on July 04,2021 at 08:08:47 UTC from IEEE Xplore. Restrictions apply.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI 10.1109/JSEN.2021.3087333, IEEE Sensors
Journal
12 IEEE SENSORS JOURNAL, VOL. XX, NO. XX, XXXX 2017
[8] G. Seo, G. Lee, M. J. Kim, S.-H. Baek, M. Choi, K. B. Ku, C.-S. [30] S. Hochreiter and J. Schmidhuber, “Long short-term memory,” Neural
Lee, S. Jun, D. Park, H. G. Kim et al., “Rapid detection of covid-19 computation, vol. 9, no. 8, pp. 1735–1780, 1997.
causative virus (sars-cov-2) in human nasopharyngeal swab specimens [31] F. A. Gers, N. N. Schraudolph, and J. Schmidhuber, “Learning precise
using field-effect transistor-based biosensor,” ACS nano, vol. 14, no. 4, timing with lstm recurrent networks,” Journal of machine learning
pp. 5135–5142, 2020. research, vol. 3, no. Aug, pp. 115–143, 2002.
[9] P. J. Bresnahan Jr, T. R. Martz, Y. Takeshita, K. S. Johnson, and [32] F. Pedregosa, G. Varoquaux, A. Gramfort, V. Michel, B. Thirion,
M. LaShomb, “Best practices for autonomous measurement of seawater O. Grisel, M. Blondel, P. Prettenhofer, R. Weiss, V. Dubourg, J. Vander-
ph with the honeywell durafet,” Methods in Oceanography, vol. 9, pp. plas, A. Passos, D. Cournapeau, M. Brucher, M. Perrot, and E. Duch-
44–60, 2014. esnay, “Scikit-learn: Machine Learning in Python,” Journal of Machine
[10] P. Bergveld, “Thirty Years of ISFETOLOGY: What Happened in the Learning Research, vol. 12, pp. 2825–2830, 2011.
Past 30 Years and What May Happen in the Next 30 Years,” Sensors [33] X. Glorot and Y. Bengio, “Understanding the difficulty of training
and Actuators B: Chemical, vol. 88, no. 1, pp. 1–20, 2003. deep feedforward neural networks,” in Proceedings of the thirteenth
[11] S. Jamasb, “Current-mode signal enhancement in the ion-selective field international conference on artificial intelligence and statistics, 2010,
effect transistor (isfet) in the presence of drift and hysteresis,” IEEE pp. 249–256.
Sensors Journal, 2020. [34] flodutot GitHub repository. (2021) Tensorflow for aarch 64. [Online].
[12] Q. Liu, X. Li, M. Ye, S. S. Ge, and X. Du, “Drift compensation for Available: https://github.com/flodutot/tensorflow_aarch64
electronic nose by semi-supervised domain adaption,” IEEE Sensors [35] L. v. d. Maaten and G. Hinton, “Visualizing data using t-sne,” Journal
Journal, vol. 14, no. 3, pp. 657–665, 2013. of machine learning research, vol. 9, no. Nov, pp. 2579–2605, 2008.
[13] L. Zhang, Y. Liu, Z. He, J. Liu, P. Deng, and X. Zhou, “Anti-drift in [36] U. B. . E. PRODUCTS. (2015) U9vl-j-p battery technical datasheet.
e-nose: A subspace projection approach with drift reduction,” Sensors [Online]. Available: https://cellpacksolutions.co.uk/wp-content/uploads/
and Actuators B: Chemical, vol. 253, pp. 407–417, 2017. 2015/06/ultralife-u9vl-jp-technical-data-sheet.pdf
[14] D. Chen and P. K. Chan, “An intelligent isfet sensory system with [37] Y. Hao and S. Quigley, “The implementation of a deep recurrent
temperature and drift compensation for long-term monitoring,” IEEE neural network language model on a xilinx fpga,” arXiv preprint
Sensors Journal, vol. 8, no. 12, pp. 1948–1959, 2008. arXiv:1710.10296, 2017.
[15] P. K. Chan and D. Chen, “A CMOS ISFET Interface Circuit with [38] A. X. M. Chang, B. Martini, and E. Culurciello, “Recurrent
Dynamic Current Temperature Compensation Technique,” IEEE Trans- neural networks hardware implementation on fpga,” arXiv preprint
actions on Circuits and Systems I: Regular Papers, vol. 54, no. 1, pp. arXiv:1511.05552, 2015.
119–129, 2007. [39] C. Gao, D. Neil, E. Ceolini, S.-C. Liu, and T. Delbruck, “Deltarnn: A
[16] C. M. Bishop, Pattern recognition and machine learning. springer, power-efficient recurrent neural network accelerator,” in Proceedings of
2006. the 2018 ACM/SIGDA International Symposium on Field-Programmable
[17] M. Mohri, A. Rostamizadeh, and A. Talwalkar, Foundations of machine Gate Arrays, 2018, pp. 21–30.
learning. MIT press, 2018. [40] S. Nakata, T. Arie, S. Akita, and K. Takei, “Wearable, flexible, and
[18] Z. C. Lipton, J. Berkowitz, and C. Elkan, “A critical review of multifunctional healthcare device with an isfet chemical sensor for
recurrent neural networks for sequence learning,” arXiv preprint simultaneous sweat ph and skin temperature monitoring,” ACS sensors,
arXiv:1506.00019, 2015. vol. 2, no. 3, pp. 443–448, 2017.
[19] R. Bhardwaj, S. Majumder, P. K. Ajmera, S. Sinha, R. Sharma, [41] W.-E. Hsu, Y.-H. Chang, and C.-T. Lin, “A machine-learning assisted
R. Mukhiya, and P. Narang, “Temperature compensation of isfet based sensor for chemo-physical dual sensing based on ion-sensitive field-
ph sensor using artificial neural networks,” in 2017 IEEE Regional effect transistor architecture,” IEEE Sensors Journal, vol. 19, no. 21,
Symposium on Micro and Nanoelectronics (RSM). IEEE, 2017, pp. pp. 9983–9990, 2019.
155–158. [42] S. Bermejo, G. Bedoya, V. Parisi, and J. Cabestany, “An on-line water
[20] R. Bhardwaj, S. Sinha, N. Sahu, S. Majumder, P. Narang, and monitoring system using a smart isfet array,” in IEEE 2002 28th Annual
R. Mukhiya, “Modeling and simulation of temperature drift for isfet- Conference of the Industrial Electronics Society. IECON 02, vol. 4.
based ph sensor and its compensation through machine learning tech- IEEE, 2002, pp. 2797–2802.
niques,” International Journal of Circuit Theory and Applications. [43] E. Galido, L. Tolentino, B. Fortaleza, R. Corvera, A. De Guzman,
[21] S. Sinha, R. Bhardwaj, N. Sahu, H. Ahuja, R. Sharma, and R. Mukhiya, V. Española, C. Gambota, A. Gungon, K. Lapuz, N. Arago et al.,
“Temperature and temporal drift compensation for al2o3-gate isfet-based “Development of a solar-powered smart aquaponics system through
ph sensor using machine learning techniques,” Microelectronics Journal, internet of things (iot),” Lecture Notes on Research and Innovation in
vol. 97, p. 104710, 2020. Computer Engineering and Computer Sciences, pp. 31–39, 2019.
[22] A. Mehta, H. Ahuja, N. Sahu, R. Bhardwaj, S. Srivastava, and S. Sinha, [44] F. Cao, F. Jiang, Z. Liu, B. Chen, and Z. Yang, “Application of isfet
“Machine learning techniques for performance enhancement of si 3 n microsensors with mobile network to build iot for water environment
4-gate isfet ph sensor,” in 2020 IEEE 17th India Council International monitoring,” in 2014 International Conference on Intelligent Environ-
Conference (INDICON). IEEE, 2020, pp. 1–7. ments. IEEE, 2014, pp. 207–210.
[23] S. Sinha, R. Mukhiya, R. Sharma, P. Khanna, and V. Khanna, “Fabric- [45] W.-E. Hsu, Y.-H. Chang, Y.-J. Huang, J.-C. Huang, and C.-T. Lin, “A
ation, characterization and electrochemical simulation of aln-gate isfet ph/light dual-modal sensing isfet assisted by artificial neural networks,”
ph sensor,” Journal of Materials Science: Materials in Electronics, pp. ECS Transactions, vol. 89, no. 6, p. 31, 2019.
1–12, 2019. [46] M. Cacho-Soblechero, K. Malpartida-Cardenas, C. Cicatiello,
[24] S. Martinoia, G. Massobrio, and L. Lorenzelli, “Modeling isfet micro- J. Rodriguez-Manzano, and P. Georgiou, “A dual-sensing thermo-
sensor and isfet-based microsystems: a review,” Sensors and Actuators chemical isfet array for dna-based diagnostics,” IEEE Transactions on
B: chemical, vol. 105, no. 1, pp. 14–27, 2005. Biomedical Circuits and Systems, vol. 14, no. 3, pp. 477–489, 2020.
[25] M. W. Shinwari, M. J. Deen, and D. Landheer, “Study of the electrolyte-
insulator-semiconductor field-effect transistor (eisfet) with applications
in biosensor design,” Microelectronics Reliability, vol. 47, no. 12, pp.
2025–2057, 2007.
[26] P. Bergveld, “Thirty years of isfetology: What happened in the past 30
years and what may happen in the next 30 years,” Sensors and Actuators
B: Chemical, vol. 88, no. 1, pp. 1–20, 2003.
[27] S. Sinha, N. Sahu, R. Bhardwaj, H. Ahuja, R. Sharma, R. Mukhiya, and
C. Shekhar, “Modeling and simulation of temporal and temperature drift
for the development of an accurate isfet spice macromodel,” Journal of
Computational Electronics, vol. 19, no. 1, pp. 367–386, 2020.
[28] S. Martinoia and G. Massobrio, “A Behavioral Macromodel of the
ISFET in SPICE,” Sensors and Actuators B: Chemical, vol. 62, no. 3,
pp. 182–189, 2000.
[29] A. Ortiz-Conde, F. G. Sánchez, J. J. Liou, A. Cerdeira, M. Estrada,
and Y. Yue, “A review of recent mosfet threshold voltage extraction
methods,” Microelectronics reliability, vol. 42, no. 4-5, pp. 583–596,
2002.
1530-437X (c) 2021 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
Authorized licensed use limited to: BOURNEMOUTH UNIVERSITY. Downloaded on July 04,2021 at 08:08:47 UTC from IEEE Xplore. Restrictions apply.