BMMS 11 WirelessMultimediaSensorNetworks

Wireless Multimedia Sensor Networks
Безжични мултимедиски системи 2022

Вонр. проф. д-р Милош Јовановиќ
Agenda
} Introduction
} WMSN Architecture
} Internal Architecture of a Multimedia Sensor Device
} Protocol Stack for WMSN
} WMSN Applications
2 Безжични мултимедиски системи 2022

Introduction
} Wireless Multimedia Sensor Networks (WMSNs)
} Low-cost micro-electro-mechanical systems technology;
} Resource-constrained wireless devices that retrieve video and
audio streams, as well as scalar sensor data;
} The network design depends significantly on the
applications
} Ideally, network nodes should maximize the perceived QoS and
minimize energy expenditure;
} Applications: scientific research, military, disaster relief and
rescue, health care, industrial, environmental, and household
monitoring;

Introduction
} Many functionalities: sensing, computation, and
communication
} Executed over a large number of battery-powered nodes,
scattered densely in a geographical area of interest;
} Timestamps
} The phenomenon being monitored by a WSN is often time
varying, so it is important to timestamp events accurately;
} Also, many wireless distributed protocols require some sort of
coordination, so clock synchronization is essential;
} Energy Efficiency
} Nodes are expected to operate autonomously with small
batteries for a number of months;
} The major power-consuming component is the radio interface;

Introduction
} Limited Range
} Individual nodes have limited range and form ad-hoc topology;
} Complex task of designing and implementing routing
algorithms for effective and efficient information exchange and
processing;
} They must be energy efficient, self-organized, robust to failures and
losses, able to handle large and dense networks;
} Internet of Things (IoT)
} A new perspective on WMSNs;

WMSN Architecture
Types of networks, nodes and architecture reference models

WMSN Architecture
} Distributed system
} Interacts with the physical environment by observing it through
multiple media;
} Online processing of the received information;
} Reacts to it by combining technologies from communications and
networking, signal processing, computer vision, control, and
robotics;
} Three groups of tasks:
} System: Each sensor node is an individual system - platforms,
operating systems, and storage schemes;
} Communication protocols: Enable communication between the
sensor nodes;
} Services: Developed to enhance the application and to improve
system performance and network efficiency;

WMSN Architecture
} New networking protocols required
} Self-organization, efficient control and management, energy
consumption, E2E delay, etc;
} Information sharing between protocol layers;
} Energy conservation maximizes network lifetime: intelligent
sensor placement, data aggregation and compression;
} Reliable communication: congestion control, buffer
monitoring, acknowledgements, packet-loss recovery;
} Degree of network coverage
} Determined by the total number of sensors in the network and
their placement;
} Depending on the application, a higher degree of coverage
may be required to increase the accuracy of the sensed data;

WMSN Architecture
} Scalar WSNs: flat and homogenous architecture
} Every sensor has the same physical capabilities and can only
interact with neighboring sensors;
} Not always suited for the traffic intensity generated by
multimedia applications;
} The processing power required for data processing,
communication, and general operation, may not be available
on each node;
} WMSNs: new architectures
} New sensor node types: multimedia sensors, multimedia
processing hubs, storage hubs, …;
} Architecture scalable and efficient, depending on the specific
application and QoS requirements;

WMSN Node Types
} Video and Audio Sensors (VAS)
} Capture sound and still / moving images of the sensed events;
} They can be arranged in a single-tier topology, or in a
hierarchical manner;
} Scalar Sensors (SS)
} Sense scalar data and physical attributes: temperature,
pressure, humidity, etc.;
} Report the measured values;
} Typically resource-constrained devices in terms of energy
supply, storage capacity, and processing capability;

WMSN Node Types
} Multimedia Processing Hub (MPH)
} Have comparatively large computational resources and are
suitable for aggregating multimedia streams from individual
sensor nodes;
} Integral in reducing both the dimensionality and the volume of
data conveyed to the sink and storage devices;
} Storage Hub (SH)
} Depending on the application, the multimedia stream may be
desired in real-time or after further processing;
} SHs allow data-mining and feature extraction algorithms to
identify the important characteristics of the event, even before
the data is sent to the end user;

WMSN Node Types
} Sink Node (SN)
} Responsible for packaging high-level user queries to network-
specific directives and return filtered portions of the
multimedia stream back to the user;
} Multiple sinks may be needed in large or heterogeneous
networks;
} Gateway (GW)
} Serves as a bridge between the sink to the IP networks;
} It is the only IP-addressable component of the WMSN;
} Maintains a geographical estimate of the area covered under
its sensing framework to allocate tasks to the appropriate sinks
that forward sensed data through it;

WMSN Architecture
} Network architectures in WMSNs can be divided into
three reference models:
1. Single-tier flat architecture
2. Single-tier clustered architecture
3. Multitier architecture with heterogeneous sensors

Single-Tier Flat Architecture
} Deployed with homogeneous sensor nodes.
} All nodes have the same sensing, computational and
communication capabilities, and functionalities;
} All nodes can perform any function: from image capturing,
through multimedia processing, to data relaying toward the SN
in multihop topology;
} Multimedia processing is distributed among the nodes, which
prolongs network lifetime;

Single-Tier Flat Architecture

Single-Tier Clustered Architecture
} Deployed with heterogeneous sensors.
} Multimedia and scalar sensors (within each cluster) relay data
to a MPH (cluster head);
} The MPH has more resources and is able to perform intensive
data processing;
} The MPH is wirelessly connected with the SN or the GW, either
directly or through other cluster heads in a multihop fashion;

Single-Tier Clustered Architecture

Multitier Architecture with Heterogeneous Sensors
} The first tier deployed with SSs performs simple tasks
} E.g. motion detection and temperature monitoring;
} The second tier of VASs can perform more complicated tasks
} E.g. object detection or object recognition;
} The third tier contains more powerful and high-resolution
VASs, capable of performing more complex tasks
} E.g. object tracking;
} Each tier can have a central hub to perform more data
processing and communicate with the higher tiers.
} Can accomplish tasks with different needs with better balance
among costs, coverage, functionality, and reliability
requirements.

Multitier Architecture with Heterogeneous Sensors

Example: Multitier, Multimodal Architecture

WMSN Architectures Comparison

Internal Architecture of a
Multimedia Sensor Device
The components of a multimedia sensor device
Internal Architecture of a Multimedia Sensor
} Composed of several basic components:
} Sensing unit;
} Central processing unit (CPU);
} Communication subsystem;
} Coordination subsystem;
} Memory;
} Mobility / Actuation unit
(optional);


} Sensing Unit
} Composed of two subunits: video, audio, and/or scalar sensors and
analog to digital converter (ADC);
} The analog signals produced by the sensors are converted into digital
signals by the ADC, and then fed into the CPU;
} CPU
} Executes the system software in charge of coordinating sensing and
communication tasks and is interfaced with a memory;
} Communication Subsystem
} Interfaces the device to the network;
} Composed of a transceiver unit and of communication software;
} Communication protocol stack and system software -- middleware,
operating systems, and virtual machines;

} Coordination Subsystem
} In charge of the operation of different network devices;
} Performs operations such as network synchronization and
location management;
} Mobility / Actuation Unit (optional)
} Can enable movement or manipulation of objects;
} Power Supply Unit (PSU)
} The entire system is powered by a power supply unit (PSU);
} E.g. batteries or solar cells;

Protocol Stack for WMSN
Design challenges for all protocol layers for WMSNs

Protocol Stack for WMSN
} Reliability and energy-efficiency are of the highest
importance, for a protocol stack for WSNs and WMSNs.
} Each sensor node uses the protocol stack to communicate with
one another and with the SN;

Physical Layer for the WMSN
} Related to the hardware transmission technologies.
} Responsible for frequency selection, modulation, and
channel encoding.
} PHY technology must work in a compatible way with
higher layers in the protocol stack to support their
application-specific requirements.
} This can be achieved with higher efficiency if a cross-layer
approach is used between physical and MAC layers;
} PHY should utilize the available bandwidth and data rate in the
best possible way, and should be more power efficient;

Physical Layer for the WMSN
} PHY in WMSN mainly rely on IEEE 802.15 and IEEE 802.11
standards.
} IEEE 802.15.4 (ZigBee) is the most common radio standard
used in WSNs, because of its simplicity and its low-cost and
low-power characteristics;
} But, ZigBee is not suitable for high data rate applications such
as multimedia streaming over WMSN and for guaranteeing
application-specific QoS;
} Bluetooth and Wi-Fi have higher data rates and code efficiency,
but they consume more energy;
} Regardless, first WMSN deployments used Bluetooth, now
mainly use Wi-Fi;

Link Layer Quality of Service Support
} QoS support mechanisms are utilized to prioritize and
manage the resource sharing according to the
requirements of each traffic class.
} Channel access policies, scheduling and buffer management,
and error correction;
} Two main categories of MAC protocols which are used:
} Contention-based protocols;
} Contention-free protocols;

} Contention-based protocols: CSMA/CA-based MAC protocols.
} Usually used in multihop wireless networking – simplicity and
adequacy for a decentralized environment;
} When a device is receiving data, transmissions from all the devices in
its transmission range are impeded;
} This is achieved by using random timers and a carrier sense
mechanism, which in turn, results in uncontrolled delay and idle
energy consumption;
} To decrease collisions and considerably reduce other sources of
energy wastage, the wake-up/sleep mechanisms and RTS/CTS/ACK
(from IEEE 802.11) are used to design energy efficient MAC protocols
for WSN --> sensor MAC (S-MAC) and time-out MAC (T-MAC);
} But, these protocols are not suitable for multimedia applications –
they are designed to be energy efficient at the cost of increased
latency and degraded network throughput;

} Contention-free protocols: Clustered on-demand multichannel
MAC (COM-MAC).
} Exploits the fact that current sensor nodes already support multiple
channels;
} The operation of proposed protocol consists of three sessions:
request session, scheduling session, and data transmission session.
} First, a scheduled multichannel medium access is used within each
cluster so that cluster members can operate in a contention-free
manner within both time and frequency domains;
} They avoid collision, idle listening, and overhearing;
} A traffic-adaptive and QoS-aware scheduling algorithm is executed to
dynamically allocate time slots and channels for sensor nodes
} Based on the current data traffic information and QoS requirements;
} Spectrum-aware automatic repeat-request (ARQ) is used to better
exploit the unused spectrum
} A balance between reliability and retransmission;

Energy-Efficient Routing Techniques with QoS
Assurances
} The network layer in WSNs handles the routing of sensed
data from the sources to the SN.
} Takes into account energy efficiency, link quality, fault
tolerance, and scalability;
} Routing techniques for WMSNs can be broadly classified
into the following characteristic groups:
} Latency-constrained routing protocols
} Multiple QoS-constrained routing protocols
} Routing for real-time streaming
} Data delivery model-based routing
} Intelligent routing
} Hole-bypassing routing
Latency-Constrained Routing Protocols
} Based on E2E delay guarantee (soft or hard real-time
bounded latency).
} Sequential assignment routing (SAR)
} Creates trees routed from the one-hop neighbor of the sink, by
using a table-based multipath routing and path restoration
technique;
} Goal: minimize the average weighted QoS metric throughout
the lifetime of the network;
} Ensures fault tolerance, and the path restoration technique
eases the recovery in case of node failure;
} Limitation of SAR: suffers from overhead of maintaining tables
and status information, when the number of nodes is huge;

} Energy-aware QoS (EAQoS)
} Aims to discover an optimal path in terms of energy
consumption and error rate, along which the E2E delay
requirement can be satisfied;
} Finds the least cost-constrained and delay-constrained path for
real-time data;
} Limitation: it does not use any priority scheme to account for
the different E2E delay requirements that multimedia traffic
may have --> not suitable for streaming applications;
} Limitation: requires complete knowledge of the network
topology at each node to calculate multiple paths --> limits the
scalability of the approach;

} SPEED
} Provides soft real-time E2E guarantees;
} Requires that each node maintains localized information with
minimal control overhead, and uses nondeterministic
geographic forwarding to find paths;
} Goal: To support a spatiotemporal communication service with
a given maximum delivery speed across the network;
} The total transmission energy is lower than standard ad-hoc
routing protocols, because of minimum control packet
overhead;
} A network-wide load balancing is achieved by the even
distribution of traffic;

Multiple QoS-Constrained Routing Protocols
} Multipath and Multi-SPEED (MMSPEED).
} Supports probabilistic QoS guarantees by provisioning QoS in
two domains: timeliness and reliability;
} This is realized in a localized way, without global network
information, by employing localized geographic packet-
forwarding
} This is augmented by dynamic compensation, which
compensates for local decision inaccuracies as a packet travels
toward its destination;
} Advantage: it guarantees E2E requirements in a localized way,
which is desirable for scalability and adaptability to large-scale
dynamic WMSNs;

Routing for Real-Time Streaming
} Challenging issue: video streaming data has a soft
deadline, with a tendency for shortest path routing
approaches with minimum E2E delay.
} Plus, bandwidth requirements can be several times higher
than the max transmission capacity of sensor nodes --> needs
multipath routing;
} Directional Geographical Routing (DGR)
} Divides a single video stream into multiple substreams;
} Exploits multiple disjoint paths to transmit them in parallel;
} Makes the best of limited bandwidth and energy in WMSNs, to
achieve reliable delivery;
} Exhibits low delay, substantially longer network lifetime, and a
better received video quality;

Data Delivery Model-Based Routing
} Realtime and energy-aware routing (REAR).
} Event-driven protocol, uses metadata to establish multipath
routing to reduce energy consumption;
} A cost function is constructed to evaluate the consumption of
bandwidth on the transmission links, which trades off the
relationship of energy and delay, and then QoS routing is
chosen;
} The E2E delay of multihop routing not only depends on transmission
distance, but also relies on relay nodes processing and queuing delay;
} Due to high bandwidth requirement of realtime multimedia
data, a classified queue model is introduced at each node;
} --> Saves energy by activating video sensors when monitoring events
occur and using metadata instead of real data in the routing process;

Intelligent Routing
} Adaptive classes of algorithms based on swarm
intelligence.
} An interesting theoretical solution, but is difficult to implement
in a real environment due to its complexity and long
adaptation time;
} Ant-based service-aware routing (ASAR).
} Periodically chooses three suitable paths to meet diverse QoS
requirements from different services (data query, stream
query, and event driven);
} Uses positive feedback mechanism used in ant-based heuristics;
} Maximizes utilization and improves network performance;
} maintains an optimal path table and a pheromone path table
at each cluster head;

Intelligent Routing
} AntSensNet - ant-based routing approach.
} Combines hierarchical structure with an ant colony optimization
(ACO) heuristic to satisfy QoS requirements;
} Is composed of both reactive and proactive components;
} Reactive: because routes are set up when needed;
} Proactive: because, while a data session is in progress, paths are probed,
maintained, and improved proactively using a set of special agents;
} The cluster network forms nodes into colonies, network route
between clusters that meet the requirements of each application
using ants, and forwarding of network traffic using the previously
discovered route by the ants;
} In the clustering process, only the channel heads transmit information
out of the cluster, which helps in preventing collisions between sensor
nodes --> energy saving and latency;

Hole-Bypassing Routing
} Geographic energy-aware multipath stream (GEAMS).
} Geographic, multipath-localized routing protocol designed to
handle multimedia streaming data;
} Maintains both QoS restriction and energy efficiency;
} Routes information based on greedy perimeter stateless
routing (GPSR), while maintaining local knowledge for
delivering this information via multipath;
} Data streams are routed by different nodes and decisions are
made locally at each hop;
} Decisions based on the remaining energy at each neighbor, the
number of hops made by the packet before it arrives at this node, the
current distance between the node and its neighbors, as well as the
history of the packets forwarded belonging to the same stream;

Specificity of Transport Layer in WMSNs
} Traditional transport protocols (e.g., TCP and UDP) cannot
be directly implemented over WSN / WMSN.
} They have distinctive features that make them different
from typical packet-switched networks:
} Network topology: dynamic environment, multihop one-to-
many topology;
} Traffic characteristics: source nodes --> the sink; continuous,
event-driven, query-driven, hybrid traffic;
} Routing constraints: limited power, bandwidth, memory;
} Application-specific QoS: diverse applications;
} Data redundancy: feature extraction, compression, data
fusion, aggregation, etc.;

Transport Layer Solutions for WMSNs (1)



Source Coding Techniques for WMSNs
} Reduction of the amount of traffic transferred over the
network is necessary
} Done by extracting useful information from the captured
images and videos;
} Source coding done by the application layer.
} General challenges:
} Real-time streaming applications are more demanding than
data-sensing applications;
} Limitations of the sensor nodes require video coding /
compression that has low complexity and consumes as little
power as possible;
} MPEG and H.264 AVC rely on a demanding processing algorithm;

Source Coding Techniques for WMSNs
} Distributed video coding (DVC).
} Used for low-complexity encoding, by shifting the complexity
to the sink side;
} Incorporates concepts from source coding with decoder side
information for creating an intracoded frame along with a side
information frame;
} With this, multimedia content can be partitioned into multiple
streams of both intracoded and decoder side information
frames -- using a simple and low-power encoder;
} The decoder at the destination side can be complex, exploiting
the availability of resources (energy and processing power
capability);

WMSN Applications
Areas where WMSNs are generally used

WMSN Applications in Various Fields

Q&A
Quiz questions to refresh what we just learned

Question 1
} The sensor devices in a wireless multimedia sensor
network can retrieve:
} Video data
} Audio data
} Scalar data

Question 2
} Which of the following is true for WMSNs?
} Sensor nodes have to perform sensing, computation, and
communication
} Sensor nodes have direct access to a live energy source, so
energy efficiency is not an issue
} The radio interface is the most power-consuming component
of a sensor node
} Sensor nodes have a very large range and can communicate
with all other sensor nodes in the WMSN

Question 3
} Which are valid WMSN node types?
} Video and Audio Sensors
} Scalar Sensors
} Multimedia Processing Hubs
} Storage Hubs
} Sink Nodes
} Gateways

Question 4
} What are some of the characteristics of a single-tier flat
architecture for WMSNs?
} All nodes have the same sensing, computational and
communication capabilities
} All nodes can perform any function: image capturing,
multimedia processing, data relaying toward the SN, etc.
} Multimedia and scalar sensors (within a cluster) relay data to a
MPH (cluster head)
} Multimedia processing is distributed among the nodes, which
prolongs network lifetime

Question 5
} Which are some areas of application for WMSNs?
} Military
} Urban surveillance
} Biometrics
} Traffic congestion monitoring
} Industrial production process
} Household monitoring
} Patient monitoring

Questions?


BMMS 11 WirelessMultimediaSensorNetworks

Uploaded by

Document Information

Original Description:

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

BMMS 11 WirelessMultimediaSensorNetworks

Uploaded by

Copyright:

Available Formats

Wireless Multimedia Sensor Networks

Безжични мултимедиски системи 2022

2 Безжични мултимедиски системи 2022

3 Безжични мултимедиски системи 2022

4 Безжични мултимедиски системи 2022

5 Безжични мултимедиски системи 2022

Types of networks, nodes and architecture reference models

7 Безжични мултимедиски системи 2022

8 Безжични мултимедиски системи 2022

9 Безжични мултимедиски системи 2022

10 Безжични мултимедиски системи 2022

11 Безжични мултимедиски системи 2022

12 Безжични мултимедиски системи 2022

13 Безжични мултимедиски системи 2022

14 Безжични мултимедиски системи 2022

15 Безжични мултимедиски системи 2022

16 Безжични мултимедиски системи 2022

17 Безжични мултимедиски системи 2022

18 Безжични мултимедиски системи 2022

19 Безжични мултимедиски системи 2022

20 Безжични мултимедиски системи 2022

21 Безжични мултимедиски системи 2022

23 Безжични мултимедиски системи 2022

24 Безжични мултимедиски системи 2022

25 Безжични мултимедиски системи 2022

26 Безжични мултимедиски системи 2022

Design challenges for all protocol layers for WMSNs

28 Безжични мултимедиски системи 2022

29 Безжични мултимедиски системи 2022

30 Безжични мултимедиски системи 2022

31 Безжични мултимедиски системи 2022

32 Безжични мултимедиски системи 2022

33 Безжични мултимедиски системи 2022

35 Безжични мултимедиски системи 2022

36 Безжични мултимедиски системи 2022

37 Безжични мултимедиски системи 2022

38 Безжични мултимедиски системи 2022

39 Безжични мултимедиски системи 2022

40 Безжични мултимедиски системи 2022

41 Безжични мултимедиски системи 2022

42 Безжични мултимедиски системи 2022

43 Безжични мултимедиски системи 2022

44 Безжични мултимедиски системи 2022

45 Безжични мултимедиски системи 2022

46 Безжични мултимедиски системи 2022

47 Безжични мултимедиски системи 2022

48 Безжични мултимедиски системи 2022

49 Безжични мултимедиски системи 2022

Areas where WMSNs are generally used

51 Безжични мултимедиски системи 2022

Quiz questions to refresh what we just learned

53 Безжични мултимедиски системи 2022

54 Безжични мултимедиски системи 2022

55 Безжични мултимедиски системи 2022

56 Безжични мултимедиски системи 2022

57 Безжични мултимедиски системи 2022

58 Безжични мултимедиски системи 2022

You might also like