Professional Documents
Culture Documents
net/publication/331534101
CITATIONS READS
2 329
10 authors, including:
Some of the authors of this publication are also working on these related projects:
Cost Efficient Automated Pisciculture Assistance System using Internet of things(IoT) View project
PROHORI: Smart Surveillance System for Security Purpose Based on RFID and Color Code Detection View project
All content following this page was uploaded by Monirul Islam Bappy on 05 March 2019.
Abstract— Earth observation nanosatellites are dedicated OBC for it. Another important module, a low
increasingly popular since they can be deployed quickly and powered deep neural network accelerator is also included
inexpensively. In this paper we have designed an innovative for the first time in the CubeSat to perform machine-
payload for imaging targeted locations on earth from a learning operations as required by our sub-mission goals in
nanosatellite, for example a 3U or 6U CubeSat. Unlike generic
Multispectral Imaging and Neural Earth Observation
payload systems our designed payload is an independent
system in the larger structure of the CubeSat. The payload Satellite (MINEOS), which is an ongoing project of North
consists of two cameras, a hyperspectral (VNIR) camera and South University’s first approach to build a 3u CubeSat.
an LWIR thermal camera, each for capturing different We have included a software defined radio (SDR) with
spectral images. For data handling and payload management, three antennas, which we will do experiment and gather
we provide a dedicated On-Board Computer (OBC). Another data transfer metrics for survey and if needed can be used
important module, a low powered Deep Learning accelerator as a backup communication channel. Lastly, a payload
is included for the first time in a real-time system (to our best sensor module comprising of various sensors will be added,
knowledge) to perform machine learning operations when which will collect numerous additional data for future or
required. For advanced communication we have included a
ongoing sub-missions.
Software Defined Radio (SDR) that will provide an advanced
backup and recovery system for the satellite’s communication II. BACKGROUND
sub-system thus reducing the sat-failure probability.
Additionally, a payload sensor module consisting of various A. Hyperspectral imaging
sensors is added which will collect numerous data for ongoing Imaging spectroscopy known as hyperspectral imaging
and future missions. Our design verifies the feasibility of the
helps measuring the spectral signatures and/or chemical
earth imaging payload concept.
composition of all features within the sensor's field of view
Keywords—CubeSat, MINEOS, Hyperspectral imaging, (FOV) [1]. Hyperspectral data extracted from each pixel
VNIR, LWIR, SDR, OBC, ADCS, DNN, VPU, RTOS, GIS, across a sequence of continuous, narrow spectral bands,
GSD, Remote sensing, Image processing. contains both spatial and spectral properties which produce
a one-dimensional spectrum when pixels within the
I. INTRODUCTION "spectral cube". are sampled across multiple narrowband
images at a particular spatial location The spectrum
We have designed the payload system differently from visualized as a plot of wavelength versus radiance or
generic payload systems, as an independent system in the reflectance can be used to determine and characterize a
larger structure of a CubeSat. The payload consists of two particular feature within the scene, based on unique spectral
cameras, a multispectral camera and an IR (Infrared) signatures known as "fingerprints" [2],[3].
thermal camera, each for different purposes. For data
handling and payload management, instead of tasking the The medium wave infrared (MWIR) ranges from 3-5
main on board computer (OBC), we have provided a microns and long wave infrared (LWIR) ranges from 8-14
microns. These bands are sometimes referred as the
"fingerprint" region of the electromagnetic spectrum, since such as CNNs(Convolution Neural Networks) [12]. In
many effluents and gases have distinctive absorption effect, many urban patterns across the world show
features used in their identification. Analysis of similarities where that variation in the morphology of
hyperspectral data across the visible, near-IR (VNIR) and features allows programs to understand expected variability
Short Wave Infrared (SWIR) portion of the spectrum deal for a class of feature. This helps the categorization models
with the reflective nature of solid and liquid materials to be aware of different spatial signatures for features such
[3],[4]. as built-up areas, roads, airports, parklands, and other
features. It can also be used to detect and monitor changes
in large construction projects in mega urban cities. Deep
neural networks (DNNs) is also a method that has become
practical for identifying and extracting high resolution aerial
and satellite imagery [5],[13],[14]. As one example, the
extraction of roads from imagery can allow the mapping of
development and likely vectors of developed areas in the
future to be more rapidly understood long before an area
even builds up[15]. Common approaches used include
neural networks models such as CNNs and other similar
algorithms that derive from CNNs or deep neural networks
[11],[16]. Deep learning has a potential to transform image
classification and its use for the spatial sciences also,
including geographic information system (GIS) [17],[18].
With large repositories now available that contain millions
of images, computers can be more easily trained to
automatically recognize and classify different objects. In
effect, this area of research and application could be highly
Figure1: Application of Hyperspectral and IR Thermal applicable to many types of spatial analyses.
imaging
C. Software Defined Radio (SDR)
The reflective region ranges from 0.38 to about 3
microns in the spectrum except for the shorter wavelength
which Earth's atmospheric cutoff in the near-UV (Ultra-
violet) limits. When applied to hyperspectral imaging, the
emissive region ranges from 7 to 15 microns where LWIR
region is also used to identify various gases [5].
Hyperspectral imaging permits finer sampling of the
spectrum of scene features which can be used to identify,
and occasionally define scene features based on their unique
spectral signatures (absorption or emissive features).
Quantitative assessment of scene materials (solids, liquids
and gases) is also allowed with the help of ultra-spectral (in
addition to some advanced hyperspectral sensors with
especially narrow spectral bandwidths) sensors [6]. Imaging
Figure2: Block Diagram of SDR architecture[28]
spectroscopy in LWIR is advantageous as it eliminates
problems associated with solar illumination as encountered The beauty to have a software baseband processing
in the VNIR/SWIR and can also be used at night. In both the chain on DSP/FPGA on small satellite payload is, it will
MWIR and LWIR, it is the emissive properties of materials help in correcting real-time baseband and RF related
that dominate their nature. Different materials within a impairments present in I/Q data with the use of advanced
given scene can be identified and characterized based on algorithms. Typically algorithms such as DC offset
their unique emissivity [3],[7],[8]. correction, I/Q gain and phase imbalance correction, time,
B. Image processing with deep neural network and frequency and channel impairment correction are
implemented in SDR receiver [19],[20]. SDR offers
machine learning multitude of advance technique for real time telemetry
Emerging focus on remote sensing applications of operations due to its flexibility to be configured on different
satellite and aerial imagery, including hyperspectral, mission scenarios on a satellite mission. It also opened a
multispectral and natural light images, including high- field of high speed data communication in smaller satellite
resolution imagery has redefined geoscience. Artificial radio communication platforms.
neural network (ANN) due to the possibility of learning, is
an appropriate tool for environmental modeling [9],[10].
Satellite imagery analysis, including automated pattern
recognition, change detection and image classification, are
the areas of focus in deep learning [11]. What is driving
some of these now is large image repositories, such as
landsat, aster, worldview satellite repositories and ImageNet
which can be used to train image classification algorithms
III. PROPOSED PAYLOAD SYSTEM DESIGN panchromatic band of 15m resolution of the targeted
locations should be taken and analyzed. For studying the
impact of climate change of rivers in the coastal zone,
various temperature readings of air particles, water body
and the environment should be collected by the equipped
IR-thermal camera to generate a thermal map of the
location [30].