Visvesvaraya Technological University

Belagavi,Karnataka
National Education Society ®
JNN College of Engineering
Department of Computer Science & Engineering

Technical Seminar on

“The Principle and Application of Hyperspectral Imaging

Technology in Detection of Handwriting”
Presented By
H M HEMANTH NAYAK 4JN20CS033

Under the Guidance of : Coordinator:

Dr. Sankhya N Nayak M.Tech, Ph.D., Dr. Manjula G R M.Tech, Ph.D.,
Associate Professor, Professor,
Dept.of CS&E Dept. of CS&E

CSE, JNNCE, Shivamogga

 CONTENTS
 Abstract
 Introduction
 Literature Survey
 Working principle
 Methodology
 Tampering Handwriting Recognition
 Cover Handwriting Recognition
 Erasable Neutral Pen Handwriting Recognition
 Advantages and Disadvantages
 Conclusion
 References CSE, JNNCE, Shivamogga
 ABSTRACT
Hyperspectral imaging technology is used to recognize handwriting, to restore the
original data, and to reappear the same colour masking handwriting. After extracting
the characteristic bands, a preliminary distinction between the sample data is made.
Each sample is then subjected to noise reduction, removal of background and
Principle Compound Analysis (PCA) is done. The method of identifying tampered
handwriting and reproduced cover handwriting is then analysed.

CSE, JNNCE, Shivamogga

 INTRODUCTION
 Hyperspectral image is a series of discrete narrow band images of electromagnetic
spectrum, which can simultaneously obtain spectral information and image
information.
 The human eye is sensitive to light in the visible range and distinguishes the materials
according to the colors as humans are unable to distinguish between the altered
handwriting.
 Handwriting recognition and tampering cover handwriting is an important evidence
in criminal procedure. Therefore, in most civil and criminal cases, it is necessary to
identify the handwriting of the neutral pens for many document identification.

CSE, JNNCE, Shivamogga

 Literature Survey
Paper Name Methodology Limitations

1. Human Tissue Diagnostics
For Physiological Information
Using Hyperspectral Image
Model, N. Vetrekar, Ingrid
Nazareth, J.S. Parab, G. M. Naik
Hyperspectral Imaging and Identifying different ink colors is tough.
Lorentz Oscillator method Clustering is difficult in representing
the different kinds of tissues.

Low feature extraction in identifying

2. Hyperspectral Imaging for Ink Spectral imaging method RGB images.
Mismatch Detection, Zohaib Accuracy level is less due to the
Khan, Faisal Shafait and Ajmal clustering of different ink combinations.
Mian

CSE, JNNCE, Shivamogga

FLOWCHART:

CSE, JNNCE, Shivamogga

 WORKING PRINCIPLE
Hyperspectral Imaging System And Principle
• The hyperspectral cameras are made up of imaging lenses, imaging spectrometers, and
CCD cameras. In the image acquisition, the experimental samples are placed on the stage.
A light source shines on an object and passes through an object. The reflected light passes
through the imaging lens and passes through the front slit of the spectrometer.

Fig 1: Principle of Hyperspectral Imaging

CSE, JNNCE, Shivamogga
•The axis of the X axis becomes one dimensional, and the spectrum is perpendicular
to the transmission grating. Dispersion occurs in the vertical slit direction. The white
composite light is divided into a series of vertical slit directions, with monochromatic
light scattered along the wavelength.

•This reduces the number of variables in the original sample data. A few of the
variables can still contain most of the original data, and can explain the
comprehensive information of the sample data.

•The main principle of principal component analysis (PCA) for dimensionality

reduction is to convert the variables of the correlation of the sample data from
adjacent bands to variables.

CSE, JNNCE, Shivamogga

 METHODOLOGY
(A). TAMPERING HANDWRITING RECOGNITION
Experimental Samples:
A sample of black neutral pen is considered and same color of different composition of pen
is tampered on the written data.
Method:
 Most of the hyperspectral images collected are background
information. Background information has a great deal of
interference to subsequent processing.
 The first step is to establish noise reduction and remove background information by
IsoData classification.

CSE, JNNCE, Shivamogga

 (a) (b) (c) (d)

Fig 2 represents (a) digital photo (b) feature extraction band (c) the minimum noise fraction(d)
independent principal component analysis (e) the two principal component analysis (f) false color
synthesis.
 Therefore, the principal component analysis method is used to reduce the dimensionality
of tampered handwriting, that is, the sample of the group can be identified.

CSE, JNNCE, Shivamogga

(B).COVER HANDWRITING RECOGNITION

Experimental Samples:
Each neutral pen is written on its respective digital serial number,
24 hours later, the same color of other brands of neutral pens
are covered.

Method:
 The principal component analysis is used with background information. The result of
false color synthesis is seen.
 It shows the processed pictures clearly show the hidden handwriting.

CSE, JNNCE, Shivamogga

 (a) (b) (c) (d)

Fig 3 represents Cover up a sample of digital photos versus the results of different
methods of processing. (a) Digital photograph. (b) The result of principal
component analysis with background information. (c) The result of principal
component analysis without background information. (d) The result of false color
synthesis.

CSE, JNNCE, Shivamogga

(C). ERASABLE NEUTRAL PEN HANDWRITING RECOGNITION
Experimental samples:
On the receipt, each pen is written with the
corresponding number and color, and then erasing the
characters behind the numbers.
Method:
 After processing each set of experimental data by black and white frame calibration,
noise reduction and principal component analysis.
 It can be seen that after the analysis of components, the erased characters are
reproduced again.

CSE, JNNCE, Shivamogga

1st Figure Copyright form erasable pen test sample,(a)the experimental
data before wiping, (b) experimental data after wiping treatment.

2nd Figure the processing result of erasable pen handwriting. (a) second
principal component (b) Third principal component. (c) Receipt, data,
digital photos; (d) Principal component analysis results.
 Advantages :
1.Detailed Spectral Information: Hyperspectral imaging captures data across a wide range of
wavelengths, providing detailed spectral information for each pixel in an image.
2.Improved Discrimination: With its ability to capture hundreds of contiguous spectral bands,
hyperspectral imaging enhances the ability to discriminate between objects or materials with similar
visual appearances but distinct spectral properties. This is particularly useful in applications such as
remote sensing, agriculture, and biomedical imaging.
3.Enhanced Target Detection: The detailed spectral information provided by hyperspectral imaging
enables better detection and classification of targets, such as minerals, vegetation types, or pollutants,
even in complex backgrounds. This is valuable for applications like environmental monitoring,
surveillance, and defense.
4.Versatility: Hyperspectral imaging can be deployed in various environments and across different
scales, from satellite-based remote sensing to handheld or airborne systems, making it versatile for a wide
range of applications.

CSE, JNNCE, Shivamogga

 Disadvantages :

1.Data Volume and Processing Complexity: The high dimensionality of hyperspectral data results in large
volumes of information that require significant storage and computational resources for processing and
analysis. Managing and interpreting this data can be complex and time-consuming.
2.Cost: Hyperspectral imaging systems tend to be expensive compared to other imaging technologies due to
the specialized hardware and complex data processing requirements.
3.Spatial Resolution: In some hyperspectral imaging systems, spatial resolution may be compromised to
accommodate spectral resolution, resulting in lower spatial detail compared to traditional imaging
techniques.
4.Sensitivity to Environmental Conditions: Hyperspectral imaging performance can be affected by
environmental factors such as atmospheric conditions, lighting variations, and sensor calibration issues.
These factors may introduce noise or artifacts into the data, potentially affecting the accuracy and reliability
of analysis results.

CSE, JNNCE, Shivamogga

 CONCLUSION

Hyperspectral images can be used to reflect different spectral characteristics of different

materials. In tamper recognition, the sample recognition is best after noise reduction,
background information removal, and principal component analysis and pseudo color
synthesis. In terms of covering the handwriting, the recognition effect was the best and
in the erasable neutral pen, the recognition effect is also ideal.

CSE, JNNCE, Shivamogga

 REFERENCES
[1]. Weili Wang, Liren Zhang, Dongmei Wei, Yuefeng Zhao , Jingjing Wang, “The Principle and Application of
Hyperspectral Imaging Technology in Detection of Handwriting” IEEE Access, vol. 11, pp.71326-71338, 2023

[2]. R. S. Gad (MIEEE), N. Vetrekar, Ingrid Nazareth, J.S. Parab, G. M. Naik “Human Tissue Diagnostics For
Physiological Information Using Hyperspectral Image Model“ Science Direct, vol. 24, pp. 229-240, 2020

[3]. Zohaib Khan, Faisal Shafait and Ajmal Mian “Hyperspectral Imaging for Ink Mismatch Detection”, IEEE Access,
vol. 11, pp. 133523-135333, 2019

[4]. Aythami Morales, Miguel A. Ferrer, Moises Diaz-Cabrera, Cristina Carmona, Gordon L.

Thomas “The use of Hyperspectral Analysis for Ink Identification in Handwritten Documents”, Science Direct, vol. 10,
22283-22296, 2018

CSE, JNNCE, Shivamogga