Professional Documents
Culture Documents
Performance Evaluation
of SM2RAIN-ASCAT Rainfall Product
Over an Agricultural Watershed of India
Deen Dayal, Gagandeep Singh, Ashish Pandey, and Praveen Kumar Gupta
14.1 Introduction
Water governs life on earth. Precipitation is a natural process responsible for the
presence of fresh water on the earth’s surface. It is one of the most critical components
which governs the hydrology of any area. The Global Climate Observing System
© The Author(s), under exclusive license to Springer Nature Switzerland AG 2022 223
A. Pandey et al. (eds.), Geospatial Technologies for Land and Water Resources
Management, Water Science and Technology Library 103,
https://doi.org/10.1007/978-3-030-90479-1_14
224 D. Dayal et al.
(GCOS) ranks it at the top in the list of essential climate variables (Maggioni and
Massari 2018). The importance of precipitation can be realized by the fact that it is
an imperative dataset that finds application in hydrology, climatology, meteorology,
ecology, and environmental assessment (Himanshu et al. 2018a, b, 2019; Anjum
et al. 2019; Sahoo et al. 2021; Swain et al. 2021). Conventionally, the most reliable
source of rainfall data is obtained from the direct measurement using rain gauges.
Still, many a time, this data is not very useful to study the spatial distribution of
rainfall due to the sparse density of the gauging stations in a particular area.
A significant limitation of gauge-based observations is a discontinuity in the
recorded observations, which often renders the data unproductive (Thakur et al.
2021). The satellite-based precipitation products (SPPs) address the concerns of
sparse and missing data. These products can provide continuous time series of data
at fine spatial resolution (Sun et al. 2018) even at inaccessible places. However,
these datasets are prone to various uncertainties attributed to recording time errors,
sensor calibration errors, and errors incorporated by the algorithms (Porcù et al.
2014; Gebremichael et al. 2005). The accuracy of the SPPs is affected by these
uncertainties. Still, considering the advantages discussed above, these products can
be employed for various applications after incorporating necessary corrections and
conducting accurate data validation using the ground-based rainfall measurements.
Microwave remote sensing (active and passive) and infrared sensors play a signif-
icant role in developing satellite-based precipitation products. There are numerous
SPPs available in the open-source domain viz Tropical Rainfall Measuring Mission
(TRMM), TRMM Multi-satellite Precipitation Analysis (TMPA), Global Satellite
Mapping of Precipitation (GSMaP), Climate Prediction Center (CPC) Morphing
(CMORPH), Precipitation Estimation from Remotely Sensed Information using Arti-
ficial Neural Networks (PERSIANN), Tropical Application of Meteorology Using
Satellite Data (TAMSAT), Integrated Multi-Satellite Retrievals for Global Precipi-
tation Measurement (GPM) (IMERG) that have been evaluated and used for various
applications (Joshi et al. 2013; Nair et al. 2009; Prakash et al. 2014,2016; Himanshu
et al. 2017a, b; Santos et al. 2021; Guptha et al. 2021; Dayal et al. 2021).
In this study, one of the recently developed remotely sensed rainfall products,
SM2RAIN-ASCAT, is evaluated over the Betwa river basin in India. This product
estimates the rainfall using the soil moisture to rain algorithm (Brocca et al. 2019a).
The performance of this dataset has been assessed in comparison with the ground-
based gridded dataset of the India Meteorological Department using various statis-
tical indices, namely probability of detection (POD), false alarm ratio (FAR), crit-
ical success index (CSI), Pearson’s correlation coefficient (R), agreement index (d),
mean absolute error (MAE), percent bias (PBias), Kling-Gupta efficiency (KGE),
and RMSE to standard deviation ratio (RSR).
14 Performance Evaluation of SM2RAIN-ASCAT Rainfall Product … 225
Betwa river basin is positioned in the central part of India. Basin’s total area is about
43,930 km2 , of which 68.9% is located in Madhya Pradesh (under ten districts of
the state) and 31.1% is under five districts of southern Uttar Pradesh (Palmate et al.
2017). It extends from 22°52 N to 26°03 N latitude and 77°6 E to 80°14 E longitude
as shown in Fig. 14.1.
The river’s full length from its origin to its confluence with the Yamuna River is
about 590 km, out of which 232 km lies in Madhya Pradesh and the rest 358 km
in Uttar Pradesh (Dayal et al. 2018). Most of the basin area (about 69%) is under
cultivation (Palmate et al. 2017). It has land covers of flat wheat-growing agriculture
to steep forest hilly areas with varying vegetation and topography in a complex
pattern. The climate of the Betwa basin is moderate, mostly dry except in monsoon
season (Chaube et al. 2011). The average annual rainfall over the basin is 953 mm, out
of which nearly 80% occurs in the monsoon season. The average annual evaporation
losses are about 1830 mm (Pandey et al. 2021). The daily mean temperature ranges
from a minimum of 8.1 °C to a maximum of 42.3 °C.
Ground rainfall data used in this study has been obtained from India Meteorological
Department (IMD), Pune. The dataset for 2007 to 2019 has been downloaded from
IMD, Pune Web site (https://www.imdpune.gov.in/Clim_Pred_LRF_New/Grided_
Data_Download.html).
The gridded dataset has been prepared at a spatial resolution of 0.25° using
the daily rainfall records from 6995 rain gauge stations (with varying availability
periods) spread over the Indian main land (Pai et al. 2014). However, the station
density varied from year to year, and on average, about 2600 stations per year were
available to prepare the gridded data. The gridded data has been prepared using
the inverse distance weighted interpolation (IDW) scheme (proposed by Shepard
1968 and locally modified by Rajeevan et al. 2006), and a maximum of four nearest
neighbor stations, within a radius of 1.5 around the grid point, have been utilized.
Betwa river basin covers 90 grids of IMD dataset, and the spatial distribution of
average annual rainfall over the basin is shown in Fig. 14.2. The average annual
rainfall over the basin from 2007 to 2019 varies from the lowest 536 mm to the
highest 1303 mm, with a mean value of 953 mm.
226 D. Dayal et al.
Fig. 14.1 Location map of the Betwa basin and IMD rainfall grids
dS(t)
nZ = p(t) − g(t) − sr (t) − e(t) (14.1)
dt
where n, Z, S, t, p, g, sr, and e are soil porosity, soil layer depth (mm), relative
soil moisture, time, rainfall (mm/day), sub-surface runoff (mm/day), surface runoff
(mm/day), and actual evapotranspiration (mm/day), respectively. The climatological
correction of rainfall estimate for reference rainfall has been carried out using the
cumulative density function (CDF) matching approach (Brocca et al. 2011). Betwa
river basin is covered by 461 grid points of SM2RAIN-ASCAT version-1.3 product,
and data for the period of 2007 to 2019 has been utilized in this study. The SM2RAIN-
ASCAT v1.3 dataset is available on a daily time resolution at a grid size of 0.1° ×
0.1° (Brocca et al. 2019b), and it can be freely downloaded from: https://zenodo.org/
record/3972958#.YBqeu_szbeQ.
228 D. Dayal et al.
14.2.4 Methodology
For the evaluation of purpose, the original grid size of 0.1° × 0.1° of SM2RAIN-
ASCAT data has been resampled at 0.25° × 0.25° to align with the IMD grid.
The performance of the daily precipitation estimates was evaluated based on several
qualitative and quantitative statistical metrics. The statistical indices which have been
used in this study are presented in Table 14.1.
where H is number of hit events, M is number of miss events, F is number of false
precipitation events, Pobs is observed precipitation, Pobs is mean observed precipi-
tation, Psat is satellite precipitation, Psat is mean satellite precipitation, n is the total
number of events, α is a measure of the flow variability error, β is a bias term, RMSE
is the root mean squared error, and σ is the standard deviation.
Table 14.1 Statistical indices with formulas and their respective range
Statistical indices Formula Theoretical range Ideal value
Probability of POD = H
H +M 0 to 1 1
detection (POD)
False alarm ratio FAR = F
H +F 0 to 1 0
(FAR)
Critical success index CSI = H
H +M+F 0 to 1 1
(CSI)
Pobs −Pobs × Psat −Psat
Pearson’s correlation R=
2 2 −1 to 1 −1 or 1
coefficient (R) Pobs −Pobs × Psat −Psat
(Pobs −Psat )2
Agreement index (d) d =1−
Psat −Pobs + Pobs −Pobs 2
-∞ to 1 1
|Pobs −Psat |
Mean absolute error MAE = n 0 to ∞ 0
(MAE)
(Pobs −Psat )
Percent bias (PBias) PBias = × 100 -∞ to ∞ 0
Pobs
Kling-Gupta KGE = 1 − -∞ to 1 1
efficiency (KGE) (R − 1)2 + (α − 1)2 + (β − 1)2
RMSE to standard RSR = RMSE
σ (Psat ) 0 to ∞ 0
deviation ratio (RSR)
14 Performance Evaluation of SM2RAIN-ASCAT Rainfall Product … 229
Table 14.1. Before the applicability of satellite-based precipitation estimates for any
hydrological application, their performance evaluation must be carried out against
the observed rainfall dataset. In this study, a comprehensive assessment of the
SM2RAIN-ASCAT rainfall product has been carried out with the IMD dataset for
2007–2019. The evaluation has been carried out on the basis of a contingency table
and quantitative indices. The gridded as well basin-averaged rainfall on a daily time
scale has been considered for the evaluation against the IMD rainfall product.
correlation (R), and agreement index (d) varies from 0.36 to 0.64 and 0.51 to 0.72,
respectively, with median values of 0.53 and 0.62.
The spatial variation of POD depicts higher values in the southwestern part of the
basin, while the majority grids of the northern part of the basin represent compara-
tively lower values. Therefore, it can be inferred that SM2RAIN-ASCAT performs
better in the southern part of the basin as compared to the northern part; however,
since the minimum POD value in the basin is 0.89, it indicates that overall, the range
of POD is indicating a good rainfall detection capability of satellite data product.
Spatial variation of FAR in the basin shows that the entire area below 24 deg N
latitude produces low false alarms. In comparison, the area above 25 deg N latitude
has high false alarms. This pattern indicates that the satellite product performs better
in the lower part of the basin. In the Betwa basin, the critical success index values
range between 0.25 and 0.5, but the majority of the basin shows values close to 0.5.
Ideally, CSI values should be 1, but with a maximum of 0.5 in the region, it can be
inferred that the product is unable to capture all the rainfall events.
The spatial variation of the agreement index over the study area depicts the values
ranging from 0.5 to 0.75. The majority of the grids possess a decent level of agree-
ment, i.e., greater than 0.6. Ideally, d = 1 indicates a perfect match, and 0 indicates
no agreement at all. Error estimation in satellite rainfall is carried out using MAE
14 Performance Evaluation of SM2RAIN-ASCAT Rainfall Product … 231
(expressed in mm/day). The spatial variation of both MAE indicates that the error
is more in the southern part of the basin, while the northern part reflects a smaller
error. This observation is not in line with the qualitative assessments, which can be
attributed to two major reasons: higher rainfall variation in the southern part of the
basin as observed in the RMSE to standard deviation ratio plot. The other reason is
the high average annual rainfall in this part of the basin as shown in Fig. 14.2, which
consequently introduces error in rainfall detection from the satellite data observa-
tions. The spatial variation in the percentage bias over the basin shows that there is
232 D. Dayal et al.
a positive bias in the northern part of the basin while the southern part shows nega-
tive bias. Finally, the spatial variability of the Pearson’s R and KGE shows overall
satisfactory performance of the SM2RAIN-ASCAT for detecting rainfall events.
Fig. 14.6 Time series plot of basin-averaged SM2RAIN-ASCAT rainfall and IMD rainfall
Acknowledgements The authors are thankful to the Department of WRD&M, IIT Roorkee and
Space Applications Centre (SAC), ISRO, Ahmedabad, for providing the laboratory facilities and
financial support to conduct this study. We extend our sincere gratitude to IMD Pune, India, and
Hydrology group of IRPI, CNR, Perugia, Italy, for providing the open-access rainfall datasets.
234 D. Dayal et al.
References
Anjum MN, Ahmad I, Ding Y, Shangguan D, Zaman M, Ijaz MW, Sarwar K, Han H, Yang, M
(2019) Assessment of IMERG-V06 precipitation product over different hydro-climatic regimes
in the Tianshan Mountains, North-Western China. Remote Sens 11(19):2314
Brocca L, Melone F, Moramarco T, Wagner W, Albergel C (2013a) Scaling and filtering approaches
for the use of satellite soil moisture observations. Remote Sens Energy Fluxes Soil Moisture
Content 411:426
Brocca L, Moramarco T, Melone F, Wagner W (2013b) A new method for rainfall estimation through
soil moisture observations. Geophys Res Lett 40(5):853–858
Brocca L, Hasenauer S, Lacava T, Melone F, Moramarco T, Wagner W, Dorigo W, Matgen P,
Martínez-Fernández J, Llorens P, Bittelli M (2011) Soil moisture estimation through ASCAT and
AMSR-E sensors: An intercomparison and validation study across Europe. Remote Sens Environ
115(12):3390–3408
Brocca L, Ciabatta L, Massari C, Moramarco T, Hahn S, Hasenauer S, Kidd R, Dorigo W, Wagner
W, Levizzani V (2014) Soil as a natural rain gauge: estimating global rainfall from satellite soil
moisture data. J Geophys Res Atmos 119(9):5128–5141
Brocca L, Filippucci P, Hahn S, Ciabatta L, Massari C, Camici S, Schüller L, Bojkov B, Wagner W
(2019a) SM2RAIN–ASCAT (2007–2018): global daily satellite rainfall data from ASCAT soil
moisture observations. Earth Syst Sci Data 11(4):1583–1601
Brocca L, Filippucci P, Hahn S, Ciabatta L, Massari C, Camici S, Schüller L, Bojkov B, Wagner W
(2019b) SM2RAIN-ASCAT (2007-June 2020): global daily satellite rainfall from ASCAT soil
moisture (Version 1.3). Zenodo. https://doi.org/10.5281/zenodo.3972958
Brocca L, Massari C, Ciabatta L, Moramarco T, Penna D, Zuecco G, Pianezzola L, Borga M, Matgen
P, Martínez-Fernández J.(2015) Rainfall estimation from in situ soil moisture observations at
several sites in Europe: an evaluation of the SM2RAIN algorithm. J Hydrol Hydromechanics
63(3):201–209
Chaube UC, Suryavanshi S, Nurzaman L, Pandey A (2011) Synthesis of flow series of tributaries
in Upper Betwa basin. Int J Environ Sci 1(7):1459
Dayal D, Pandey A, Himanshu SK, Palmate SS (2018) Long term historic changes of precipitation
and aridity index over an Indian River Basin. World environmental and water resources congress
2018: Groundwater, sustainability, and hydro-climate/climate change. American Society of Civil
Engineers, Reston, VA, pp 262–272
Dayal D, Gupta PK, Pandey A (2021) Streamflow estimation using satellite-retrieved water fluxes
and machine learning technique over monsoon-dominated catchments of India. Hydrol Sci J
66(4):656–671
Gebremichael M, Krajewski WF, Morrissey ML, Huffman GJ, Adler RF (2005) A detailed eval-
uation of GPCP 1 daily rainfall estimates over the Mississippi River Basin. J Appl Meteorol
Climatol 44(5):665–681
Guptha GC, Swain S, Al-Ansari N, Taloor AK, Dayal D (2021) Evaluation of an urban drainage
system and its resilience using remote sensing and GIS. Remote Sensing Applications: Society
and Environment 23:100601. https://doi.org/10.1016/j.rsase.2021.100601
Himanshu SK, Pandey A, Shrestha P (2017a) Application of SWAT in an Indian river basin for
modeling runoff, sediment and water balance. Environ Earth Sci 76(1). https://doi.org/10.1007/
s12665-016-6316-8
Himanshu SK, Pandey A, Yadav B (2017b) Assessing the applicability of TMPA-3B42V7 precipita-
tion dataset in wavelet-support vector machine approach for suspended sediment load prediction.
J Hydrol 550:103–117
Himanshu SK, Pandey A, Dayal D (2018a) Evaluation of satellite-based precipitation estimates
over an agricultural watershed of India. World environmental and water resources congress 2018:
watershed management, irrigation and drainage, and water resources planning and management.
American Society of Civil Engineers, Reston, VA, pp 308–320
14 Performance Evaluation of SM2RAIN-ASCAT Rainfall Product … 235
Himanshu SK, Pandey A, Patil A (2018b) Hydrologic Evaluation of the TMPA-3B42V7 Precip-
itation Data Set over an Agricultural Watershed Using the SWAT Model. J Hydrol Eng
23(4):05018003. https://doi.org/10.1061/(ASCE)HE.1943-5584.0001629
Himanshu SK, Pandey A, Yadav B, Gupta A (2019) Evaluation of best management practices for
sediment and nutrient loss control using SWAT model. Soil and Tillage Res 192:42–58. https://
doi.org/10.1016/j.still.2019.04.016
Joshi MK, Rai A, Pandey AC (2013) Validation of TMPA and GPCP 1DD against the ground truth
rain-gauge data for Indian region. Int J Climatol 33(12):2633–2648
Maggioni V, Massari C (2018) On the performance of satellite precipitation products in riverine
flood modeling: a review. J Hydrol 558:214–224
Massari C, Su CH, Brocca L, Sang YF, Ciabatta L, Ryu D, Wagner W (2017) Near real time
de-noising of satellite-based soil moisture retrievals: an intercomparison among three different
techniques. Remote Sens Environ 198:17–29
Nair S, Srinivasan G, Nemani R (2009) Evaluation of multi-satellite TRMM derived rainfall
estimates over a western state of India. J Meteorol Soc Japan. Ser. II, 87(6):927–939
Pai DS, Sridhar L, Rajeevan M, Sreejith OP, Satbhai NS, Mukhopadhyay B (2014) Development of
a new high spatial resolution (0.25× 0.25) long period (1901–2010) daily gridded rainfall data
set over India and its comparison with existing data sets over the region. Mausam 65(1):1–18
Palmate SS, Ashish P, Mishra SK (2017) Modelling spatiotemporal land dynamics for a trans-
boundary river basin using integrated Cellular Automata and Markov Chain approach. Appl
Geogr 82:11–23
PandeyA, Dayal D, Palmate SS, Mishra SK, Himanshu SK, Pandey RP (2021) Long-term historic
changes in temperature and potential evapotranspiration over betwa river Basin. In: Climate
impacts on water resources in India. Springer, Cham, pp 267–286
Porcù F, Milani L, Petracca M (2014) On the uncertainties in validating satellite instantaneous
rainfall estimates with raingauge operational network. Atmos Res 144:73–81
Prakash S, Sathiyamoorthy V, Mahesh C, Gairola RM (2014) An evaluation of high-resolution
multisatellite rainfall products over the Indian monsoon region. Int J Remote Sens 35(9):3018–
3035
Prakash S, Mitra AK, Rajagopal EN, Pai DS (2016) Assessment of TRMM-based TMPA-3B42 and
GSMaP precipitation products over India for the peak southwest monsoon season. Int J Climatol
36(4):1614–1631
Rajeevan M, Bhate J, Kale JD, Lal B (2006) High resolution daily gridded rainfall data for the
Indian region: Analysis of break and active monsoon spells. Curr Sci 296–306
Sahoo S, Swain S, Goswami A, Sharma R, Pateriya B (2021) Assessment of trends and multi-
decadal changes in groundwater level in parts of the Malwa region, Punjab, India. Groundwater
for Sustain Dev 14:100644. https://doi.org/10.1016/j.gsd.2021.100644
Santos CAG, Neto RMB, do Nascimento TVM, da Silva RM, Mishra M, Frade TG (2021) Geospatial
drought severity analysis based on PERSIANN-CDR-estimated rainfall data for Odisha state in
India (1983–2018). Sci Total Environ 750:141258
Schaefer JT (1990) The critical success index as an indicator of warning skill. Weather Forecast
5(4):570–575
Shepard D (1968) A two-dimensional interpolation function for irregularly-spaced data. In:
Proceedings of the 1968 23rd ACM national conference, pp 517–524
Sun Q, Miao C, Duan Q, Ashouri H, Sorooshian S, Hsu KL (2018) A review of global precipitation
data sets: data sources, estimation, and intercomparisons. Rev Geophys 56(1):79–107
Swain S, Mishra SK, Pandey A (2021) A detailed assessment of meteorological drought char-
acteristics using simplified rainfall index over Narmada River Basin, India. Environ Earth Sci
80(6):1–15
Thakur PK, Garg V, Kalura P, Agrawal B, Sharma V, Mohapatra M, Kalia M, Aggarwal SP, Calmant
S, Ghosh S, Dhote PR, Sharma R, Chauhan P (2021) Water level status of Indian reservoirs: a
synoptic view from altimeter observations. Advances in Space Research 68(2):619–640. https://
doi.org/10.1016/j.asr.2020.06.015
236 D. Dayal et al.
Wagner W, Lemoine G, Rott H (1999) A method for estimating soil moisture from ERS scatterometer
and soil data. Remote Sens Environ 70(2):191–207
Wagner W, Hahn S, Kidd R, Melzer T, Bartalis Z, Hasenauer S, Figa-Saldaña J, De Rosnay P, Jann
A, Schneider S, Rubel F (2013) The ASCAT soil moisture product: a review of its specifications,
validation results, and emerging applications. Meteorol Z 22(1):5–33