You are on page 1of 6

A novel approach for automatic avalanche detection System

Mr Ashish Sharma¹, Dr Farzil Kidwai¹, Mr Yogesh ¹Computer Science and Engineering Department,
Sharma¹, Dr Sandeep Tayal¹, Prakhar Sharma¹, Harsh Maharaja Agrasen Institute of Technology, Affiliated
Rajput¹, Divleen Kaur¹, Tripti Jain¹, Mridul Gulati¹, to G.G.S.I.P. University.
Ishaan Sangwan¹ dchugh121@gmail.com
prakharsharma22@gmail.com jaintripti59@gmail.com
ashish@mait.ac.in b.birla167@gmail.com
sandeeptayal@mait.ac.in vkharshrajput@gmail.com
yogeshsharma@mait.ac.in mridulgulati18@gmail.com
farzilkidwai@mait.ac.in ishaansangwan@gmail.com

Abstract -Cities worldwide are reaching operational INTRODUCTION


excellence and growing smarter with the introduction of
innovative technologies. These technologies, if utilized Natural calamities have always existed. However, many
efficiently, can become assets of tomorrow. Many weather-related natural disasters have increased in frequency
weather-related natural disasters have increased in and severity due to the modernization of several cultures
frequency and severity in recent times. These natural around the world and the impact human industrial activities
disasters can devastate the environment, the economy, and have made on the environment. This results in a greater
life as we know it. Technology, if used as an instrumental overall worldwide impact of natural disasters. The number of
asset can enhance our preparedness for emergencies. lives lost due to these mishaps is appalling.
Utilizing vision-based strategies to prevent natural
disasters like avalanches have been one of the significant
advancements. A valuable tool for avalanche forecasting
and evaluating the efficacy of avalanche prevention
measures in low visibility conditions is automated snow
avalanche prediction. Automation offers an easy escape
from the hassle of continuous human monitoring of
avalanche activity and increases detection speed and
accuracy. Our solution offers an economic and precise Graph 1: It shows the number of deaths due to avalanches
alternative to traditional prediction systems. It takes into over the decades
account different climatological factors related to snow
stability to predict avalanche danger. The system analyses These unfortunate instances, though cannot be avoided, can
past and present activity to predict if avalanches can be be less destructive if one is better prepared. Technology has
developed. It consists of a thermal imaging camera that empowered us to do this. Multiple approaches to help predict
collects infrared images of cracked snow. These images the arrival and effect of natural calamities have been proposed
are then subsequently examined with the help of a using different technological stacks. The motive of this study
deep-learning image processing model to investigate the is to put forward one such strategy for avalanches. When a
likelihood of an avalanche occurring in the crack. The layer of snow moves downhill and collapses, it triggers an
prediction, if positive the authorities can be alerted and avalanche. The release of snow is attributed to a number of
further necessary actions can be taken. mechanisms, including snow distortion, damage
accumulation, fracture initiating, and crack propagation. This
Keywords: avalanche1 , automated avalanche detection2 , results in either dry slab avalanches or loose avalanches. The
cracks3 , thermal camera4 , image processing5 , release of snow is also a result of complex interactions
between the terrain, the snowpack, and the environment. Our
Convolutional Neural Networks (CNN)6 , Geotagging7 ,
prediction system consists of a thermal camera and an
OTSU algorithm8 . image-processing deep-learning model. The DL model is
based on OTSU Image Processing Algorithm that quantifies
cracks and checks the images for damage severity. As part of

Electronic copy available at: https://ssrn.com/abstract=4392679


the OTSU algorithm, thermal camera images undergo Furthermore, a Vision-based approach can be used for crack
enhancement, including reducing background noise and detection and analysis. A trained and proven deep learning
removing unwanted information. The length and width of the algorithm, the CNN (Convolutional Neural Network), can be
snow crack are then calculated and compared to previous very effective at processing images. Without any additional
trends to determine if the crack may lead to an impending features, CNN can learn the characteristics of the images that
avalanche at that location. are provided. Additionally, CNN is not easily influenced by
noise or the surroundings' location [15].
LITERATURE SURVEY
Snow masses that slide down steep slopes rapidly are known HARDWARE
as avalanches.[1] The release of snow is caused by a number WORKING OF THERMAL CAMERAS
of processes, including snow deformation, damage A thermal or infrared camera consists of a lens, temperature
accumulation, fracture initiation, and fracture propagation, sensor, processing circuitry, and mechanical housing. Infrared
according to a focus on dry slab avalanches and loose snow light is focused on the sensor through a lens. Sensors may
avalanches [2]. Additionally, the three main factors that contain the capacity to have pixel arrays ranging from 80 x 60
interact to cause snow avalanches are the terrain, the to 1280 x 1024 or even more. Their image resolution is
snowpack, and the meteorology [3] For centuries, avalanches inferior to the imagers got using visible light due to the
have been proven to be dangerous.[4] Snow avalanches well-known fact that the thermal detectors must capture
endanger mountain residents' lives and futures, disrupting energy at wavelengths which are very much longer than
transportation and mobility. Avalanches are often visible light and require plenty of substantial detector
spontaneous, but they are also influenced by weather and elements. Thermal imaging cameras typically have fewer
snow conditions, as well as their interaction with pixels and lower resolution than visual sensors of the same
topography.[5] In the coming years, there is an increasing risk mechanical size. When choosing an infrared camera it is
of avalanches, even in the Western Himalayan regions of important to consider its resolution, range, the field of view,
India, which calls for a better avalanche detection model. focus, thermal sensitivity and spectral range.
[6][7] Avalanches can occur on fractured snow slopes.
Therefore, to forecast avalanches, cracks must be thoroughly
examined. Now that thermographic technology has advanced,
we could indeed capture images of the ruptured surface and
use them to conduct research.Cracks formed in frozen soil are
nearly identical to those formed in snow. [8][9]Infrared
cameras, or more specifically thermal cameras, provide the
surface temperature profiles of the cracked surface along with
an image of the surface that can be used for visual inspection.
There are numerous uses for infrared thermal scanners. Fig 1. Thermal Camera image that we will be using for
[10]One such use case is utilising different colour palettes, to the hardware
represent temperatures in the resulting image [11]adopted by Image source: Robu.in
the edge/border tracing algorithms Sobel-Feldman and
Laplacian to analyse twelve commercially available and Thermal imaging cameras can measure heat very accurately,
widely used colour schemes to determine which ones were which makes them versatile. FLIR thermal imaging cameras
best for tropical environments.[12] It has been instrumental in can detect thermal changes as small as 0.01°C and display
guiding academics and developers on how to effectively them in various shades of grey or colour schemes. Thermal
describe thermal images and create colour schemes energy is released from everything we encounter in our daily
appropriate for hot climates[13]. lives, including ice.
The study concluded that colour palettes with a large number The hotter something is, the more thermal energy it releases.
of colours produced more noise, making it challenging to tell The "heat signature" refers to this released thermal energy.
an object being scanned apart from its surroundings. Regardless of lighting, thermal sensors can detect differences
Contrarily, colour schemes with three or fewer clashing hues in temperature characteristics between two objects when they
result in sharper, more precise images are in close proximity.
Machine learning-based avalanche prediction models are As a result, a smoke-like, completely dark environment
extremely scarce. However, strategies like artificial neural appears in the thermal imager. Infrared cameras can see many
networks (ANN) can be successful strategies for machine things that regular cameras and our eyes can't, but they can
learning-based avalanche prediction models.[14]. also be blocked by unexpected objects.

Electronic copy available at: https://ssrn.com/abstract=4392679


APPLICATIONS OF THERMAL CAMERA Thermal cameras are placed at strategic locations facing the
Thermal cameras have a plethora of possible applications. snowy mountains and capture infrared (IR) images of the
Thermal cameras, which were initially created for snow. These images are passed through a colour gradient
surveillance and military operations, are now widely used for model to extract information.
a variety of purposes, including building inspections The colour gradient model involves colour transitions,
(moisture, insulation, roofing, etc.), firefighting, autonomous blending one shade into another. From the colour gradient
vehicles and automatic braking, skin temperature screening, model, we get each pixel’s IR brightness temperature. Then,
industrial inspections, scientific research, and many others. the pixel brightness temperature is converted to a radiance
value. The radiance value of a pixel serves as an intensity
RASPBERRY PI measure and is used to characterize diffuse emission. A
The third generation Raspberry Pi is the Raspberry Pi 3 minimum detection threshold is applied to the calculated
Model B. An alternative to the Raspberry Pi Model B+ and radiance value. If the minimum threshold is exceeded, FRP is
Raspberry Pi 2 Model B, this rugged credit-card-sized calculated. FRP is the rate of fire radiative energy per unit of
single-board computer can perform a variety of tasks. The time. It is the difference between the measured apparent fire
Raspberry Pi 3 Model B offers a more powerful processor that temperature at the 4 (mu)m band and the background
is 10x faster than the Raspberry Pi 1 while maintaining the temperature. Instantaneous image FRP is calculated by
popular board structure. It also includes WiFi and Bluetooth iterating in all the pixels of the image, this is done till the
connectivity, making it ideal for robust connectivity designs. threshold is not exceeded. By iterating through all the
possible pixels and the values of the threshold, the widespread
background can be identified. After this, FRE- fire radiative
energy is calculated and the time-integrated area is. With this,
the infrared image is converted completely into a
colour-graded image.

Fig 2. Raspberry Pi
Image source: Robu.in

SYSTEM ARCHITECTURE

Fig 4. The temperature profile of the Snow Specimen

GEOTAGGING
Adding geographic coordinates to material depending on the
location of a mobile device is known as geotagging. Geotags,
which may also include timestamps or other contextual
information, can be added to images, videos, websites, texts,
and QR codes.
By integrating geotagging, and infrared technology, we can
determine the angle along which a crack runs and the distance
along the geotagged line that the fracture extends. This
enables us to establish a connection between the real world
and a 3D virtual representation.

Geotagging relies heavily on precision and detail. Consumers


using social media to share their location demand precise,
specific alternatives, and businesses need to be able to dig
down to the right geographic level for their analyses.
Fig 3. System Architecture

Electronic copy available at: https://ssrn.com/abstract=4392679


After the 3D view of the place is virtually created in the OTSU then uses an image histogram of grayscale levels to
computer, now the need to map the virtual model to the compute threshold value T and peaks in an image. The
physical world, here we geotag a virtual image coordinate to a intra-class variance is lowered and we get a binary image.
physical world coordinate. Now this point will be considered
as the mean position in both physical and virtual coordinate
systems.
Now the deviation of any point from the mean position is
calculated to map the point in the physical world or virtual
view. And the altitude and distance from the device will
always remain constant in the virtual view and physical
world.
Thermal Imaging Flowchart

Fig 6. Thresholding OTSU method

The binary image follows image enhancement and connecting


breakpoints to fill gaps and unconnected parts that may have
persisted. Once this process is done we get the final image.
On further analysis, we apply boundaries and calculate the
width and height of the crack. The crack analysis considers
several properties like length, width, area, orientation and
boundary. If the severity of the crack lies in the danger zone,
an impending avalanche is predicted.
According to CNN, if the surface is found cracked the OTSU
Fig 5. Thermal Imaging flowchart image processing algorithm is used on it for further crack
quantification.
OTSU Image Processing

This colour-graded image is sent into a convolutional neural


network. Convolutional neural networks are a class of
artificial neural networks (ANN), that are designed to solve
problems involving visual imagery. CNNs perform image
recognition and image analysis, and most importantly they
help with in-depth estimation. We have used the OTSU
algorithm under CNN. OTSU Image processing is a DL-based
image technique that is used to classify cracks and quantify
them to assess the degree of severity.
This method consists of three stages namely
1. Image improvement
2. Thresholding otsu method and
3. Noise removal and image correction.
After these three stages, we get the perfect image. The image
improvement method removes unwanted information,
background noise and illumination using a non-linear filter.
This gives us an improved image. Fig 7. Noise removal and Image Correction

Electronic copy available at: https://ssrn.com/abstract=4392679


or gas combination detonated in the beginning zone causes a
shock wave, adding pressure to the snowpack. This triggers
the avalanche. The fragile layer of the snowpack may fracture
as a result of the pressure. The snow slab above the broken
layer is then released as the fracture spreads. Permanently
placed explosive devices have grown in acceptance over the
past few years and are now typical.
Artificial avalanche release is a widely used and cost-effective
method of protecting roads, railroads, ski resorts, and other
locations that can be efficiently and completely evacuated
with little or no risk of property damage.[Fig 8] The use of
artificial avalanche releases to protect permanent, valuable
facilities such as homes is controversial and generally avoided
in the United States because of potential unintended
consequences and the assumption of responsibility for the
damage.
They effectively start the fracture by using a gas or charge to
create an explosion above the snowpack. These devices may
be used in any weather, at any time of day, and from a secure
distance. Over the past ten years, permanent explosive
systems have seen significant improvement. There are about
300 such systems operating in Switzerland. For the purpose of
monitoring both the explosion and the dangerous region, they
Fig 8. Crack analysis flowchart are increasingly being integrated with new technologies, such
as avalanche detection systems or warning and alarm systems.
The acceptable closure interval, residual risk, topographical
circumstances, the timing of execution, necessary explosive
impact, and cost are among the factors that influence the
delivery method chosen. We contrast the several explosive
methods and share our conclusions.
Safety authorities can choose the technology that best suits
their demands thanks to this research.

Conclusion:
An avalanche is a rapid flow of snow down a slope, such as a
hill or a mountain When a layer of snow moves downhill and
Fig 8. Artificial Avalanche triggering collapses, it triggers an avalanche. The release of snow is
attributed to a number of mechanisms, including snow
distortion, damage accumulation, fracture initiating, and crack
ARTIFICIAL AVALANCHE TRIGGERING propagation. An avalanche is able to obstruct anything in its
path. Roads and railways can be blocked. Power supplies can
In Switzerland, artificial avalanche triggering is extremely be cut off. A powerful avalanche can even destroy buildings
important for safeguarding communities, winter sports and people can also be killed. It’s a Great loss of economy
destinations, and transportation routes. The technique uses and resources. Our prediction system consists of a thermal
controlled explosives to temporarily secure avalanche camera and an image-processing deep-learning model. The
pathways, deposition zones, and potential beginning zones DL model is based on OTSU Image Processing Algorithm
while avoiding massive avalanches and protracted closures. that quantifies cracks and checks the images for damage
severity. As part of the OTSU algorithm, thermal camera
Avalanches are artificially triggered using a variety of images undergo image enhancement, which includes reducing
techniques, such as hand charge delivery, helicopter charge background noise and removing unwanted information. The
drop, cannons, and permanently erect triggers. In each length and width of the snow crack are then calculated and
instance, the same basic idea holds true: an explosive charge

Electronic copy available at: https://ssrn.com/abstract=4392679


compared to previous trends to determine if the crack may Technol. (Nat. Sci. Ed.) 2010.
lead to an impending avalanche at that location.
After processing the images taken by the thermal camera, a [7]Budzier, H.; Gerlach, G. Thermal infrared Sensors:
Vision-based approach is required for crack detection and Theory, Optimization, and Practice; Wiley: Chichester, UK;
analysis. The CNN (Convolutional neural network) is a Hoboken, NJ, USA, 2010; Volume 2010.
trained and validated deep learning algorithm that can bring
great success in processing images. CNN can learn the [8]Shea, C. and Jamieson, B.: Some fundamentals of
characteristics of the provided images without any additional handheld snow surface thermography, The Cryosphere, 5,
features. Also, CNN is not easily affected by noise or the 55–66, https://doi.org/10.5194/tc-5-55-2011, 2011.
location of the surroundings. [(J. Yang, 2019)]
Avalanches are artificially triggered using a variety of [9]Shea, C., Jamieson, B., and Birkeland, K. W.: Use of a
techniques, such as hand charge delivery, helicopter charge thermal imager for snow pit temperatures, The Cryosphere, 6,
drop, cannons, and permanently erect triggers. In each 287–299, https://doi.org/10.5194/tc-6-287-2012, 2012.
instance, the same basic idea holds true: an explosive charge
or gas combination detonated in the beginning zone causes a [10]J. Yang, W. Wang, G. Lin, Q. Li, Y. Sun and Y. Sun,
shock wave, adding pressure to the snowpack. This triggers "Infrared Thermal Imaging-Based Crack Detection Using
the avalanche. Deep Learning," in IEEE Access, vol. 7, pp. 182060-182077,
We have utilized technology in an efficient manner to 2019, doi: 10.1109/ACCESS.2019.2958264.
decrease the destruction done by Avalanche.
[11]Christen, A., Oldroyd, H. J., Diebold, M., Huwald, H.,
References and Parlange, M. B., “Spatial Structure of Turbulent Heat
Exchange at the Snow-Atmosphere Interface Inferred from
[1]Rees, K., Garrett, T., Singh, D., Pardyjak, E., and Reaburn, Time-sequential Infrared Thermography”, vol. 2013, 2013.
A., “A new particle-by -particle hot plate technique for
measurement of precipitation rate, snow density and [12]Zhao Y, Han Y, Chen C, Seo H. Crack Detection in
visibility”, 2020. doi:10.5194/egusphere-egu2020-6148. Frozen Soils Using Infrared Thermographic Camera. Sensors.
2022; 22(3):885. https://doi.org/10.339.
[2]Schweizer, J. (2003). Snow avalanche formation. Reviews
of Geophysics, 41(4). doi:10.1029/2002rg000123 [13]Jr., R. , Olalia, J. and Carse, M. (2021) Evaluating
Infrared Thermal Image’s Color Palettes in Hot Tropical Area.
[3] Singh, Amreek & Ganju, Ashwagosh. (2008). Artificial Journal of Computer and Communications, 9, 37-49. doi:
Neural Networks for Snow Avalanche Forecasting in Indian 10.4236/jcc.2021.911003.
Himalaya. 12th International Conference on Computer
Methods and Advances in Geomechanics 2008. 3. [14]D. Soukup and R. Huber-Mörk, ``Convolutional neural
networks for
[4]Fredston, Jill and Fesler, Doug. 1994, New Ed., Snow steel surface defect detection from photometric stereo
Sense, A Guide to Evaluating Snow Avalanche Hazard. images,'' in
Alaska Mountain Safety Center, Inc. 116 pp. Proc. Int. Symp. Vis. Comput. Cham, Switzerland: Springer,
2014,
[5]J. A. Ballesteros-Cánovas, D. Trappmann, J. pp. 668677.
Madrigal-González, N. Eckert, & M. Stoffel (2018). Climate
warming enhances snow avalanche risk in the Western [15]Y. LeCun, Y. Bengio, and G. Hinton, ”Deep learning,”
Himalayas. Proceedings of the National Academy of Nature, vol. 521,
Sciences, 115(13), 3410-3415 no. 7553, p. 436, 2015.

[6]Lin, Z.Z.G.J.Y.; Chengrui, Z. Active infrared icing


detection using neural networks. J. Huazhong Univ. Sci.

Electronic copy available at: https://ssrn.com/abstract=4392679

You might also like