Internet Sensing:

Challenges and Opportunities

Subhas Mukhopadhyay, FIEEE, FIEE

Professor of Sensing Technology
School of Engineering and Advanced Technology
 Timeline at Massey
2000.9: Joined Massey as SL R1

2004.9: Promoted to SL R2, effective from Jan. 2005

2005.9: Promoted to AP, effective from Jan. 2006

2010.11: Elevated to IEEE Fellow, effective from Jan. 2011

2011.10: Promoted to Professor, effective from Jan. 2012

My family – Four members, Four different Country of Birth
Contents of the talk:

Introduction

Our research

Internet and Internet Sensing

Challenges and Opportunities

Summary
 Sensing
Motto of research: Sensors for life.
• Initiate and continuation of International Conference on
Sensing Technology (ICST)
>> ICST 2005, NZ
>> ICST 2007, NZ
>> ICST 2008, Taiwan
>> ICST 2010, Italy
>> ICST 2011, NZ
>> ICST 2012, India
>> ICST 2013, Wellington, December 3 to 5, 2013
>> ICST 2014, Liverpool, UK, Sep. 2-4. 2014
>> ICST 2015, Auckland, NZ, Dec. 8-10. 2015 (Upcoming event)

• Launch and continuation of International Journal on Smart

Sensing and Intelligent Systems (www.s2is.org), 2008
Sensing devices around us

“If you cannot measure it,

you cannot improve it.”
Lord Kelvin, 1824-1907
 Sensors: Wired vs Wireless
Cost:

Flexibility:

Power Options:

Ease of installations:

Replacement:
Wireless Sensor Network - WSN
Wireless Sensor Network

User

Gateway Node

Wireless Sensor Node

 • Precision agriculture Applications of WSN
• Environment comfort &
efficiency
• Smart homes
• Alarms, security, surveillance.
• Disaster management
• Health Care
• Traffic Management
• Transportation safety
Sensor Augmented Fire Response
• Land mine Detection

Wind Response Elder Care

Earthquake Response Manufacturing
A few projects of

S2IS Group
Research on SMART SENSING
 Seafood Inspection Tool (SIT)

Sensor sensitivity with water and different concentration

of DA injected to mussel

29 Wa ter
10.1 µg DA
21.2 µg DA
42.5 µg DA

Sensitivity, %
24 85.0 µg DA
170 µg DA

19

14
0.00 0.01 0.02 0.03 0.04 0.05 0.06
Amout of chemicals injected to sample, ml

9V and -9V Supply Novel Planar Interdigital Sensor

Sensor sensitivity with normal samples and samples
35
injected with DA of different thickness

30

25

Sensitivity, %
20

15

10

5 No rma l
+DA
0
1.0 1.1 1.2 1.3 1.4 1.5 1.6 1.7 1.8 1.9 2.0 2.1 2.2 2.3 2.4 2.5 2.6 2.7 2.8 2.9 3.0 3.1 3.2 3.3 3.4 3.5

Sample thickness, mm
SiLab C8051F020 Microcontroller Signal Processing Circuit

A.R. Mohd Syaifudin, K.P. Jayasundera, S.C. Mukhopadhyay, “A Low Cost Novel Sensing System for Detection of
Dangerous Marine Biotoxins in Seafood”, Sensors and Actuators B: Chemical 137, 2009, pp. 67–75
Novel Sensors with Different Coatings for Detection of Pathogen

(C) Dip-coated silica coating

functionalized with APTES (3-AMINOPROPYLTRIETHOXYSILANE)
-6E+05
Control LPS_01ug
LPS_1ug LPS_10ug
-5E+05 LPS_100ug LPS_1000ug

-4E+05
Im (Z), W

-3E+05

-2E+05

-1E+05

0E+00 1E+05 2E+05 3E+05 4E+05 5E+05

0E+00
Re(Z),
Detection of Bacterial Endotoxin in Food: New Planar Interdigital Sensors based Approach, Journal W Engineering (2013), 114, 346-3
of Food
Smart sensing for Phthalates detection in water and beverages

90
1500000 Zimag Sensi-
80 tivity (200
1000000 Zreal (Ω)
Zimg and Zreal 70
Hz)

500000 VS

Zimag Sensitivity (%)

Z. Guo, D. Wei, M. Wang et al., “Determination of six
phthalic acid esters in orange juice packaged by PVC bottle
60
using SPE and HPLC-UV: Application to the migration
study,” Journal of chromatographic science, vol. 48, no. 9, 0 Frequency 50
pp. 760-765, 2010.
-500000 40
Zimag (Ω)

-1000000 Zreal (Control) 30

ZImg (Control)
-1500000 20
Zreal F(2ppb)
-2000000 ZImg F(2ppb) 10
Zreal E(20ppb)
0
-2500000 2000 200 20 2
-3000000 DEHP Concentration (Parts per Billion)
Asif I. Zia, Mohd Syaifudin Abdul Rahman, Subhas Chandra Mukhopadhyay, Pak-Lam Yu, I.H. Al-Bahadly, Chinthaka P. Gooneratne, Jürgen
-3500000
Kosel, Tai-Shan Liao, Technique for rapid detection of phthalates in water and beverages, Journal of Food Engineering 116 (2013) 515–523.
 Molecular recognition for rapid detection system
of Phthalates
b Recognition

Molecular
Imprinting
Polymer
Laboratory preparation of MIP DEHP Extraction EIS setup for rapid testing system
(Soxhlet)
EXPERIMENTAL

EIS NYQUIST PLOT- DEHP-in MIP(0.1Hz-10kHz)

-18000000
-16000000
RESULTS

Imaginary Z (kΩ)

-14000000

-12000000

-10000000

-8000000
-6000000
-4000000

-2000000 AVERAGE -100 ppm DEHP-MIP AVERAGE-200 ppm DEHP-inMIP

AVERAGE-10 ppm DEHP-inMIP AVERAGE MIP in MilliQ(CONTROL)
0
0 10000000 20000000 30000000 40000000 50000000
Real Z (kΩ)
 Sensor for Environmental Monitoring

Mohd. Amri Yunus and S. C. Mukhopadhyay, “Novel Planar Electromagnetic Sensors for Detection of
Nitrates and Contamination in Natural Water Sources”, IEEE Sensors Journal, Vol. 11, No. 6, June 2011,
Research on Intelligent Systems

INTERNET SENSING based HOME

AUTOMATION Project
 Wireless Sensor Network Based Smart Home

 
 

Panic Button “Grandma is not WELL”

A. Gaddam, et. al.,, “Elderly Care Based on Cognitive Sensor Network”, IEEE Sensors Journal, Vol. 11,
No. 3, March 2011, pp. 574-581.
 Best Student paper: HiNZ 2013

Suryadevara N.K, and Mukhopadhyay S.C, "Smart Healthcare Monitoring System", www.hinz,org.nz. Health Informatics New
Zealand, November 27-29, 2013.
 Wireless Sensor Network Based Physiological
Parameters Measurement

K. Kaur, S. C. Mukhopadhyay, J. Schnepper, M. Haefke and H. Ewald, “A Zigbee Based Wearable Physiological
Parameters Monitoring System”, IEEE Sensors Journal, Vol. 12, No. 3, March 2012, pp.423-430.
N.K.Suryadevara, A. Gaddam, R.K.Rayudu and S.C. Mukhopadhyay, “Wireless Sensors Network based safe Home
to care Elderly People: Behaviour Detection”, Sens. Actuators A: Phys. (2012), doi:10.1016/j.sna.2012.03.020,
Volume 186, 2012, pp. 277 – 283.
 Fabricated Developed System – Sensors Modules
Human Emotion Recognition Unit

Angry Happy Sad Neutral

T. Quazi, S.C. Mukhopadhyay, N. Suryadevara and Y. M. Huang, Towards the Smart Sensors Based Human
Emotion Recognition, Proceedings of IEEE I2MTC 2012 conference, IEEE Catalog number CFP12MT-CDR, ISBN
978-1-4577-1771-0, May 13-16, 2012, Graz, Austria, pp. 2365-2370.
 Intelligent Building – Smart Power Management and WSN

Sensing Device + Lamp

Xbee End Device

Heater

Xbee Kettle
Coordinator
Toaster

Washing
Machine
S.P.S. Gill, N. K. Suryadevara and S. C. Mukhopadhyay, Smart Power Monitoring System Using Wireless Sensor Networks, Proceedings of
the 2012 Sixth International Conference on Sensing Technology, ISBN 978-1-4673-2245-4, Kolkata, India, Dec. 18-21, 2012, pp. 444-449.
 IoT based HMS-SETUP
Smart Home Server
#1
Internet

Secured – (OPEN VPN)

MySql-Replication

Sensor Data Acquisition Sensor Events Detection

(C#) No-IP, Web Server (Apache)
Database Server (MySql) Database Server (MySql)
Open-VPN(Client) PHP Scripts, JQuery, Flot
Open-VPN(Server)

N.K. Suryadevara, S.C. Mukhopadhyay, R. Wang, R.K. Rayudu, Forecasting the behavior of an elderly using
wireless sensors data in a smart home, Engineering Applications of Artificial Intelligence, Volume 26, Issue 10,
November 2013, Pages 2641-2652, ISSN 0952-1976, http://dx.doi.org/10.1016/j.engappai.2013.08.004.
SMART HOME

www.iots2is.org
 Computers and Internets

“In a few decades time, computers

will be inter-woven into almost
every industrial product”
Karl Steinbuch, German Computer
Science Pioneer, 1966
 What is the Internet?
• The largest network of networks in
the world.
• Uses TCP/IP protocols and packet
switching.
• Runs on any communications
substrate.

Dr. Vinton Cerf,

Co-Creator of TCP/IP
New
Zealand
situation
Internet Sensing (Internet of Things)
‘The Internet of Things’ is a network of items –
each embedded with sensors – which are connected
to the Internet.

“… all about physical items talking to each

other..”

Machine-to-machine communications and person-

to-computer communications will be extended to
things.

Technologies that will drive the future Internet

of Things: Sensor technologies including RFID,
smart things, nanotechnology and
miniaturization.
Population, connected devices, IoT
 Fundamental block for Internet Sensing

Two ways for sensor data uploading :

• Local Home gateway Server
• Cloud Computing

Classical approach: Local Home gateway server

 Fundamental block for Internet Sensing

• Cloud Computing: Integrating sensors

into computing devices
A few examples
 Aggregating Radiation Data
Fukushima Radiation Monitoring

http://jciv.iidj.net/map/
Raising Air Quality Awareness

http://airqualityegg.com/
http://article.wn.com/view/2014/02/12/Internet_of_Things_Part
_1_Gods_Gift_to_the_NSA
/
http://www.lawa.org.nz/
 Issues here
* Good initiative

• Off-line and is updated annually

• The samples are collected at some

specific points, tests are conducted at
laboratory,

• Possibility of human errors.

Internet Sensing: Semantic Sensor Web

The system uses the Internet as a scaffold to

support and transmit its sensations.

It consists of millions of embedded electronic

measuring devices: thermostats, pressure
gauges, pollution detectors, cameras,
microphones, glucose sensors, ECGs,
electroencephalographs.

These will probe and monitor cities and

endangered species, the atmosphere, our
ships, highways and fleets of trucks, our
conversations, our bodies--even our dreams.
 Tomorrow’s ubiquitous world of
tags, sensors and smart systems
Internet Sensing: Future Scenario
Trillions of things collecting data

Computation
Cloud-
Computing

Big Data
 Challenges of Internet Sensing
 Availability of internet at everywhere at all time
 Acceptability among the society and individual
 Low-cost smart sensor node development
 Energy harvesting
 Computational ability
 Security issues,
 Scalability, Reliability
 Fault Tolerance
 Power Consumption of nodes and transceiver
 Power Supply for sensor nodes
Battery selection:
Type of battery (Alkaline, Lithium-Ion, NiCad,
NiMH, Lead-Acid)
 Life-time (Ahr requirement)
Environmental impact
Cost
Size
Memory effect
Safety issue
Etc.
Opportunity: Development of Environmentally
friendly new types of rechargeable batteries.

Research on Energy harvesting techniques.

Other Challenges: Emerging
Environmental Issues, e-Waste
Dumping of
computers,
monitors, cell-
phones??

Donate those items

to underdeveloped
countries to be
used at school or
other educational
organizations?
E-Waste: Opportunity
Design Bio-
degradable WSN

Design Non-
Hazardous WSN
 Dependence on technology
• Dependent on electricity,
• More dependence on computer,
• Even greater Dependence on internet.

Failure due to
• Design faults
• Material defects
• Sabotage
• Overloading
• Natural disasters.

>> Disastrous effect on economy and

society – A huge challenge to design
failsafe system.
Opportunities for New Zealand

• Environmental Monitoring:
River water
Nitrate leaching
Lake water
Land

• Agricultural monitoring
• Water use
• Fertilizer use
Availability of 3G in NZ
Though, there are issues related to

>> Resources
>> Reliable infrastructure
>> Appropriate economic and legal conditions
>> Social consensus and acceptability.

But, Internet Sensing is going to

come in our life sooner or later. So
better to be well prepared in advance.
 Acknowledgement

IIST, SEAT and Massey University

Students, Colleagues and Friends

Collaborative Universities and

international colleagues

IEEE

Family
 International Collaboration
KAUST, SA
 Thank You

Questions & Comments

 IoT: International Status
Europe:
http://ec.europa.eu/information_society/policy/rfid/events/past/Info1802
2009/index_en.htm

 
Taiwan: Intel-NTU Connected Context Computing Center
http://ccc.ntu.edu.tw/

Target objectives:

Low-power Circuits for Intelligent Sensor Nodes

Energy Harvesting Techniques and Their Applications
Modeling and Analysis of Large-Scale Heterogeneous Data
Flexible Spectrum Management for M2M Wireless Networks
Low-cost Public-key Cryptography for M2M using Scalable Coprocessors
M2M-based Context-aware Home Energy Saving System
Extend the Safety Shield: an Early Warning System for Vehicles
Development of a Remote Ecological Monitoring System
Self-organizing Energy Efficient M2M Communications (SEE-M2M)
 China:
http://en.wuxi.gov.cn/web111/Events/InternetofThings/AboutInternetofThi
ngs/index.shtml

Wuxi ( 无 锡 ) is a city on the Yangtse River between Suzhou and

Nanjing, and is located in the south of Jiangsu Province, half way
between the cities of Shanghai and Nanjing, with Shanghai 128km to its
east and Nanjing 183km to its west. To its south is Lake Taihu and to its
north is Yangtse River. The city is under direct jurisdiction of the province
and governs three cities and six districts. Wuxi administers 9 county-level
divisions, including 7 districts and 2 county-level cities. Because of its
recent development, Wuxi has been dubbed the "little Shanghai".
Taiwan: Intel-NTU Connected Context Computing Center
http://ccc.ntu.edu.tw/