You are on page 1of 15

ABSTRACT

Target detection in outdoor and Remote Sensing (RS) images plays a pivotal role in vari-
ous fields, including civil, military, traffic surveillance, and disaster forecast. However, amidst
harsh environmental conditions and escalating air contaminants, the presence of haze signifi-
cantly diminishes image visibility, creating difficulties in accurately characterizing ground tar-
gets. With the rise of industrial development, haze occurrences have become more frequent,
amplifying the issue. This project introduces an efficient dehazing method developed to con-
front the challenge of reducing haze in the images. This project introduces a novel approach
to image dehazing, which employs both digital image processing techniques and deep learn-
ing. The method initially employs digital image processing techniques and leverages both
image restoration and enhancement. Specifically, it utilizes the Dark Channel Prior (DCP),
Atmospheric Scattering Model (ASM), and Retinex. The implementation involves merging the
Atmospheric Scattering Model (ASM) and Retinex to formulate a novel dehazing model, aug-
menting image quality during the dehazing process. To address inaccuracies in transmittance
calculation within existing methods, a Gaussian-weighted image fusion is introduced, resulting
in a refined transmittance. Additionally, to counteract image color distortion after dehazing,
an Unsharp Mask (USM) method is employed for corrective measures. In addition to image
processing techniques, CNN-based dehazing is utilized to compare its performance with digital
image processing. The objective is to demonstrate the superiority of digital image processing
over deep learning methods in dehazing. Evaluation is conducted using metrics such as Peak
Signal-to-Noise Ratio (PSNR) and Structural Similarity Index (SSIM), with values of 25 and
0.9, respectively, along with a Mean Absolute Error (MAE) value of 30. These metrics high-
light the effectiveness of Digital Image Processing techniques in achieving superior results for
dehazing the images. Through this approach, the method aims to provide clear, true-color im-
ages while preserving details, effectively addressing challenges in outdoor and remote sensing
imaging. It offers a robust dehazing solution applicable across diverse domains, particularly in
scenarios requiring precise target detection under challenging atmospheric conditions.

Keywords: Atmospheric Scattering Model (ASM), Retinex, Dark Channel Prior (DCP),
Remote Sensing Images (RS), Convolutional Neural Network (CNN).

iii
Contents

DECLARATION i

ACKNOWLEDGEMENT ii

ABSTRACT iii

LIST OF FIGURES vi

LIST OF TABLES vii

LIST OF ABBREVIATIONS viii

1 INTRODUCTION 1

1.1 Need for the Project . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1

1.2 Objective . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1

1.3 Scope of the Project . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2

1.4 Organization of Thesis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2

2 LITERATURE REVIEW 3

2.1 Existing System . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3

2.2 Study on Existing System . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3

2.3 Gap Identification . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5

3 PROPOSED SYSTEM 6

3.1 Methodologies of Proposed System . . . . . . . . . . . . . . . . . . . . . . . 6

iv
3.1.1 System Architecture . . . . . . . . . . . . . . . . . . . . . . . . . . . 7

3.2 Materials and Methods . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9

3.2.1 Tools . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9

4 RESULTS AND ANALYSIS 11

4.1 Results . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11

4.2 Performance Analysis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13

4.2.1 Evaluation Metrics . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13

5 CONCLUSION 17

6 FUTURE SCOPE 18

BIBLIOGRAPHY 19

APPENDIX 20

v
LIST OF FIGURES

3.1 System Architecture . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8

4.1 Hazy Image . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11

4.2 Dehazed image using Digital Image Processing . . . . . . . . . . . . . . . . . 12

4.3 Dehazed image using CNN . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12

4.4 PSNR of 5 images . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14

4.5 SSIM of 5 images . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14

4.6 MAE of 5 images . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15

6.1 Haze image . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25

6.2 Dehazed image using Digital Image processing . . . . . . . . . . . . . . . . . 26

6.3 Dehazed Image using CNN . . . . . . . . . . . . . . . . . . . . . . . . . . . . 27

6.4 GitHub History . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28

vi
LIST OF TABLES

2.1 Literature Review . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4

4.1 Comparison of PSNR, SSIM and MAE for Digital Image Processing and CNN 15

vii
LIST OF ABBREVIATIONS

Abbreviations Definition
ASM Atmospheric Scattering Model
CNN Convolutional Neural Network
DCP Dark Channel Prior
MAE Mean Absolute Error
PSNR Peak Signal to Noise Ratio
RS Remote Sensing
SSIM Structural Similarity
USM Unsharp Masking Method

viii
Chapter 1

INTRODUCTION

In this chapter the project’s core motivations, highlighting its aim to address crucial chal-
lenges in dehazing the images is provided.

1.1 Need for the Project


This project titled ” Efficient Dehazing Method for Outdoor and Remote Sensing Images”
address the challenge of image degradation caused by haze in outdoor and Remote Sensing (RS)
images, which can significantly impact target detection, identification, and tracking in various
fields such as civil and military applications, traffic surveillance, and disaster forecasting. The
existing dehazing methods are limited in their ability to effectively dehaze both outdoor and RS
images, as they are based on image enhancement, restoration or Deep Learning methods and
often result in inaccurate transmittance calculation and color distortion after dehazing. There-
fore, the need for this project is to develop an efficient dehazing method that can be applied
to both outdoor and RS images, leveraging the advantages of image enhancement and restora-
tion methods. The proposed method aims to refine transmittance calculation and correct image
color distortion, ultimately improving the quality of dehazed images and enabling better target
detection and identification in outdoor and RS images.

1.2 Objective
The objective of the project is to develop an efficient dehazing method that can be applied
to images. The proposed method aims to address the challenges of inaccurate transmittance cal-
culation and color distortion after dehazing, which are common limitations of existing dehazing
methods. By leveraging the advantages of both image enhancement and restoration-based de-
hazing methods, the proposed method introduces a Gaussian-weighted image fusion to refine
transmittance calculation and correct image color distortion using an unsharp mask method.
Additionally, a Convolutional Neural Network (CNN) model is implemented for dehazing the
images. This project is then compares deep learning and digital image processing methods for
dehazing the images by evaluating their effectiveness in enhancing image clarity and preserv-
ing crucial details. The ultimate goal is to improve the quality of dehazed images, particularly

1
in adverse weather conditions, and to enhance target detection, identification, and tracking in
outdoor and RS images. The project also aims to overcome the limitations of existing dehazing
methods and to provide a more efficient and cost-effective solution for actual applications.

1.3 Scope of the Project


The project’s scope involves the design and implementation of a sophisticated dehazing
method with a primary emphasis on effectively eliminating haze from both outdoor and re-
mote sensing (RS) images. This initiative is motivated by a commitment to address prevalent
challenges associated with existing dehazing techniques, notably inaccuracies in transmittance
calculation and color distortion in the resultant dehazed images. The project strategically inte-
grates components from image enhancement and restoration-based dehazing approaches, seek-
ing to harness the inherent strengths of each. Specifically, the image enhancement aspect aims
to elevate visual quality, making obscured details more noticeable, while the restoration-based
approach focuses on recovering information lost due to haze. By harmonizing these elements,
the project aims to collaboratively enhance the overall efficiency and efficacy of the dehazing
method. Key objectives include refining transmittance calculations for increased accuracy and
resolving color distortion issues in the dehazed images. The overarching goal is to establish
a robust and versatile dehazing methodology, capable of addressing challenges in diverse real-
world scenarios and surpassing limitations observed in current dehazing methods.

1.4 Organization of Thesis


In the subsequent chapters, the document delves into a comprehensive exploration of the ex-
isting systems and literature, highlighting gaps identified in current research. Following this,
Chapter 3 presents the proposed system, detailing its design, methodology, and tools utilized.
Chapter 4 then presents the results obtained and initiates analysis around them, analyzing find-
ings in the context of the proposed system’s objectives. Finally, Chapter 5 concludes the doc-
ument, summarizing key insights, implications and avenues for future research discussed in
Chapter 6.

2
Chapter 2

LITERATURE REVIEW

In this chapter a comprehensive overview of existing research and studies relevant to the
dehazing methods, providing insights into current methodologies and challenges in the field has
been provided.

2.1 Existing System


Existing dehazing methods often specialize in either image enhancement-based techniques
or image restoration, rather than integrating both approaches. They are limited by their suitabil-
ity for either outdoor or Remote Sensing (RS) images due to differences in their characteristics
and acquisition conditions. These methods frequently rely on fixed windows for transmittance
calculation, leading to inaccuracies, particularly in scenes with varying haze levels. Moreover,
they lack a refinement process, resulting in residual haze and poor image quality.

2.2 Study on Existing System


A. J Pazhani and S. Periyanayag [2] proposed ”A novel haze removal computing architec-
ture for remote sensing images using multi-scale Retinex technique”. They have used Multi-
scale retinex histogram equalization with U- Net Dense Opti- mized Pyramidal (MSRHE with
U- Net DOPT) which improve the image efficiency to generate haze-free image.

H. Yu et al. [3] proposed ”A novel night time dehazing model integrating Retinex algorithm
and Atmospheric Scattering Model”. They have combines the Retinex and the atmospheric
scattering models. This model effectively remove the haze in the night time image and restore
the detailed information of the image.

Soo-Chang Pei et al. [5] proposed ”Night time haze re- moval using color transfer prepro-
cessing and Dark Channnel Prior”. They have used Dark Channel Prior(DCP) model. This
model have reliable capabilities for removing nighttime haze and attractive for some applica-
tions computer vision, vehicle, aviation and national defense security.

Song et al. [4] proposed ”WSAMF-Net: Wavelet Spatial Attention-Based MultiStream


Feedback Network for Single Image Dehazing”. They have used wavelet spatial attention

3
based multi-stream feedback network (WSAMF-Net) . They have incorporates both frequency-
domain and spatial-domain information to enhance features and improves clarity in structures
and edges for more effective single image dehazing.

F. A. Dharejo et al. [6] proposed ”A deep hybrid neural network for single image dehazing
via wavelet transform”. They have used convolution neural network (CNN) in the wavelet
domain (WH-Net). This method achieve multi-level representations of hazy images to provide
local and global information and provide a clearer image of dehaze.

Jianhua Guo et al. proposed ”Landsat-8 OLI Multispectral Image Dehazing Based on Op-
timized Atmospheric Scattering Model”. They have used theAtmospheric Scattering Model.
This method is able to remove haze successfully and significantly improve the image visibility
as well as correct the spectral bias to some degree.

Table 2.1: Literature Review

Sl No. Title Author Model Features Limitations


1 A novel haze removal A.J Pazhani Multi-scale Improve the image efficiency Inaccurate improvement in
computing architecture and S. retinex histogram to generate haze-free image image clarity.
for remote sensing images Periyanayag equalization with
using multi-scale Retinex U- Net Dense
technique (2022) Optimized Pyra-
midal (MSRHE
with U- Net
DOPT)
2 Nighttime haze removal S. C. Pei Dark Channel Reliable capabilities for re- Fixed window for transmit-
using color transfer pre- and T. Y. Prior(DCP) moving nighttime haze and tance calculation, leading to
processing and Dark Lee attractive for some applica- distorted image colors
Channel Prior(2021) tions computer vision, vehi-
cle, aviation and national de-
fense security
3 A novel night time de- H. Yu et al. Combines the Effectively remove the haze Inaccurate improvement in
hazing model integrating Retinex and the in the nighttime image and re- image clarity.
Retinex algorithm and Atmospheric store the detailed information
Atmospheric Scattering Scattering Mod- of the image
Model els
4 WSAMF-Net: Wavelet X. Song et WSAMF-Net Incorporates both frequency- Increased computational
spatial attention-based al. domain and spatial-domain complexity due to the incor-
multistream feedback information to enhance fea- poration of wavelet spatial
network for single image tures and improves clarity in attention, multi-stream feed-
dehazing (2023) structures and edges for more back and feature fusion
effective single image dehaz-
ing.

4
Sl No. Title Author Model Features Limitations
5 A deep hybrid neural net- Dharejo et convolution Incorporates both frequency- Loss of detailed information,
work for single image de- al. neural network domain and spatial-domain noise and oversaturation.
hazing via wavelet trans- (CNN) in the information to enhance fea-
form(2021) wavelet domain tures and improves clarity in
(WH-Net) structures and edges for more
effective single image dehaz-
ing
6 Landsat-8 OLI Multi- Jianhua Atmospheric Able to remove haze success- Dehazed image still has resid-
spectral Image Dehazing Guo et al. Scattering Model fully and significantly im- ual haze
Based on Optimized prove the image visibility as
Atmospheric Scattering well as correct the spectral
Model (2020) bias to some degree

2.3 Gap Identification


Existing dehazing methods suffer from inaccuracies in transmittance calculation and often
fail to address image color distortion post-dehazing. Moreover, they are typically specialized in
either image restoration or enhancement, limiting their versatility. This specialization leads to
compromised image quality or inadequate haze removal. The proposed method aims to over-
come these limitations by offering versatile dehazing solution capable of effectively addressing
these limitations and preserving image quality across diverse scenarios.

The literature survey chapter concludes by summarizing important findings and pointing out
gaps in the current state of research on dehazing the image. These insights inform the project’s
methodology and direct future research into Digital Image Processing-based techniques for
dehazing the images.

5
Chapter 3

PROPOSED SYSTEM

In this chapter a comprehensive methodologies and system architecture for dehazing


the images is provided.

The proposed system introduces an efficient dehazing method aimed at reducing haze in
images. It employs a novel approach combining digital image processing techniques and deep
learning method. Initially, the method utilizes Dark Channel Prior (DCP), Atmospheric Scat-
tering Model (ASM) and Retinex for image restoration and image enhancement. The impl-
mentation invloves by merging the Atmospheric Scattering Model (ASM) and Retinex, a novel
dehazing model is formulated to augment image quality during the dehazing process. To address
the inaccuracies in transmittance calculation within existing methods, a Gaussian-weighted im-
age fusion is introduced, resulting in a refined transmittance. Additionally, an Unsharp Mask
(USM) method is employed to counteract image color distortion ater dehazing the image. The
system also incorporates CNN-based dehazing the image for comparative evaluation with dig-
ital image processing, aiming to demonstrate its superiority. Evaluation metrics such as Peak
Signal-to-Noise Ratio (PSNR), Structural Similarity Index (SSIM), and Mean Absolute Error
(MAE) confirm the effectiveness of digital image processing techniques in achieving superior
dehazing results for the images.

3.1 Methodologies of Proposed System


• Dark Channel Prior (DCP) : This initial step estimates the thickness of haze present in the
image and removes it, thereby enhancing visibility, particularly in hazy conditions.

• Atmospheric Scattering Model (ASM) : Within the dehazing process, ASM estimates the
transmission map of the scene based on DCP and atmospheric light conditions. This helps
in quantifying and removing haze effects from the image more accurately.

• Multi-scale Retinex: After dehazing, multi-scale Retinex is applied to further improve


contrast and preserve image details across different scales. This enhances the overall
quality of the image, making it visually appealing.

6
• Gaussian-weighted Image Fusion : This technique combines the dehazed and retinex-
enhanced images using Gaussian weighting, producing a final output with balanced con-
trast and brightness. This step ensures that enhancements from both DCP and multi-scale
Retinex are properly integrated.

• Unsharp Masking (USM) : Following fusion, USM is applied for further detail enhance-
ment and sharpening. This ensures that fine details are emphasized and the final output is
visually appealing and perceptually accurate.

• CNN Model : Implementing a CNN model for dehazing images involves training the
model on a dataset of hazy and clear image pairs, enabling it to learn the mapping from
hazy inputs image to clearer haze free image, subsequently allowing for the deployment
of the trained model to enhance visibility in hazy conditions.

In conclusion, the dehazing process integrates various techniques, each playing a crucial role
in enhancing image quality in hazy conditions. Beginning with Dark Channel Prior and Atmo-
spheric Scattering Model for haze estimation and removal, followed by Multi-scale Retinex for
contrast enhancement, the process ensures better visibility and detail preservation. Gaussian-
weighted Image Fusion further refines the output, while Unsharp Masking enhances fine details.
The CNN-based dehazing process involves training a neural network to learn the mapping be-
tween hazy and dehazed images.Through extensive training on a dataset containing pairs of hazy
and corresponding ground truth clear images, the CNN learns to extract features and patterns
that enable it to effectively reduce haze in images. During evaluation by metrics such as Peak
Signal-to-Noise Ratio (PSNR), Structural Similarity Index (SSIM), and Mean Absolute Error
(MAE) the dehazed image obtained through CNN-based methods are compared with those
achieved using digital image processing techniques.Through this evaluation, the proposed sys-
tem aims to demonstrate the effectiveness of digital image processing techniques in achieving
superior dehazing results while providing a benchmark for CNN-based methods in the context
of haze reduction in images.

3.1.1 System Architecture


The dehazing system architecture begins with separate phases for Digital Image Process-
ing and Deep Learning. Initially, traditional image processing techniques such as Dark Chan-
nel Prior (DCP), Atmospheric Scattering Light estimation,Retinex, Gaussian Weighted Image

7
Fusion, and then Unsharp Mask Method are applied independently for contrast enhancement,
image restoration and haze removal.Retinex used for image enhancement while ASM used for
image restoration. A Gaussian-weighted image fusion fuses the Retinex and ASM method is
proposed to refine the transmittance and improve accuracy when calculating the transmittance.
As the dehazed image is subject to color distortion, USM method is used to correct the image
to obtain a clear and true color image.

The Deep Learning phase utilizes Dehaze dataset from Kaggle, comprising 13,840 images
categorized into clear (840) and hazy (13,000) conditions. The dataset was partitioned into a
90% training set and a 10% testing set for model evaluation. Convolutional Neural Networks
(CNNs) were employed for deep learning-based dehazing, with preprocessing steps including
resizing, normalization, and augmentation. The CNNs were trained to minimize the disparity
between predicted and ground truth dehazed images. Both Digital Image Processing techniques
and Deep Learning approaches were integrated into a unified interface for users to compare
their efficacy in addressing haze removal challenges.

Figure 3.1: System Architecture

8
3.2 Materials and Methods

This section critically examines tools, technologies and environmental setup used in devel-
oping the content trading system. It provides a detailed overview of software, hardware, and
setup procedures, enabling to understand the technical infrastructure supporting the project’s
objectives and methodologies.

3.2.1 Tools
1. Vs code: Visual Studio Code (VS Code) is a versatile and customizable integrated devel-
opment environment (IDE) developed by Microsoft. This platform, utilized for the project
on image dehazing, offers a range of library features essential for efficient development.
These include syntax highlighting, code completion, debugging capabilities, version con-
trol integration (such as Git), support for extensions, and a lightweight yet powerful in-
terface. These features enhance productivity, streamline the development process, and
provide flexibility for implementing and testing image dehazing algorithms effectively.

2. Kaggle Notebook: In a Kaggle notebook for a dehazing project, users can leverage var-
ious datasets available on the platform to train and evaluate their models. Kaggle hosts a
diverse range of datasets that may include hazy images paired with their corresponding
clear images, facilitating supervised learning approaches for dehazing algorithms. These
datasets may be sourced from different domains and environments, providing a rich vari-
ety of scenes and conditions for training robust dehazing models. Additionally, Kaggle’s
dataset exploration tools and community-driven discussions enable users to discover, an-
alyze, and contribute to datasets relevant to their dehazing project, fostering collaboration
and knowledge sharing within the data science community. Overall, the availability of
datasets on Kaggle enhances the accessibility and effectiveness of dehazing projects by
providing a wealth of data for training and experimentation.

3. Python: Python offers a versatile and efficient platform for dehazing, a crucial task in
image processing and computer vision. With libraries like OpenCV and scikit-image,
Python provides a rich ecosystem of tools for implementing dehazing algorithms. Addi-
tionally, machine learning frameworks such as TensorFlow and PyTorch enable the de-
velopment of sophisticated deep learning models for dehazing tasks. Python’s simplicity

You might also like