You are on page 1of 16

ESA Climate Change Initiative (CCI) Page 1

Version 3.0
System Verification Report (SVR)
GHG-CCI Phase 2 CRDP#4
for sub-system CO2_GOS_SRFP 30 August 2016

for the Essential Climate Variable (ECV)


Greenhouse Gases (GHG)

ESA Climate Change Initiative (CCI)

System Verification Report (SVR)


GHG-CCI Phase 2 CRDP#4
for sub-system CO2_GOS_SRFP v2.3.8

for the Essential Climate Variable (ECV)


Greenhouse Gases (GHG)

Written by: R. Detmers, SRON


ESA Climate Change Initiative (CCI) Page 2
Version 3.0
System Verification Report (SVR)
GHG-CCI Phase 2 CRDP#4
for sub-system CO2_GOS_SRFP 30 August 2016

for the Essential Climate Variable (ECV)


Greenhouse Gases (GHG)

Change log:
Version Nr. Date Status Reason for
change
Version 1 Sept 2, 2014 Draft 1 New document

Version 1 Sept 24 2014 Draft 2 Comments from O.


Hasekamp

Version 2 4 October 2015 Draft 1 CRDP #3

Version 3.0 30 August 2016 Draft 1 CRDP#4


ESA Climate Change Initiative (CCI) Page 3
Version 3.0
System Verification Report (SVR)
GHG-CCI Phase 2 CRDP#4
for sub-system CO2_GOS_SRFP 30 August 2016

for the Essential Climate Variable (ECV)


Greenhouse Gases (GHG)

Table of Contents
1 Purpose of document.......................................................................................................... 4

2 Overview ............................................................................................................................. 5

3 Verification .......................................................................................................................... 7

3.1 Method......................................................................................................................... 7

3.2 Results......................................................................................................................... 7

3.3 Summary and conclusions .......................................................................................... 9

4 Initial validation ................................................................................................................. 10

5 References........................................................................................................................ 13

6 Acronyms .......................................................................................................................... 15
ESA Climate Change Initiative (CCI) Page 4
Version 3.0
System Verification Report (SVR)
GHG-CCI Phase 2 CRDP#4
for sub-system CO2_GOS_SRFP 30 August 2016

for the Essential Climate Variable (ECV)


Greenhouse Gases (GHG)

1 Purpose of document
This document is the System Verification Report (SVR) for the sub-system used to generate
data product CO2_GOS_SRFP v2.3.8 of GHG-CCI Climate Research Data Package No. 4
(CRDP#4).
This document is a deliverable of the ESA project GHG-CCI (http://www.esa-ghg-cci.org)
/Buchwitz et al., 2013/.
Please see that website for a description of all GHG-CCI data products including the
CO2_GOS_SRFP product.
This document also contains initial validation results for the GOSAT XCO2 RemoTeC Full
Physics v2.3.8 data product.
ESA Climate Change Initiative (CCI) Page 5
Version 3.0
System Verification Report (SVR)
GHG-CCI Phase 2 CRDP#4
for sub-system CO2_GOS_SRFP 30 August 2016

for the Essential Climate Variable (ECV)


Greenhouse Gases (GHG)

2 Overview
This document is the System Verification Report (SVR) for the sub-system used to generate
data product CO2_GOS_SRFP v2.3.8 of Climate Research Data Package No. 2 (CRDP#4).
This document is a deliverable of the ESA project GHG-CCI (http://www.esa-ghg-cci.org)
/Buchwitz et al., 2013/. Please see that website for a description of all GHG-CCI data
products.
The GHG-CCI data products are available from:
http://www.esa-ghg-cci.org/ -> CRDP (Data)
( http://www.esa-ghg-cci.org/sites/default/files/documents/public/doc uments/GHG-CCI_DA TA.html )

The GHG-CCI data products are being generated using a distributed system which consists
of several sub-systems.

In this document the verification of the sub-system used to generate product


CO2_GOS_SRFP (v2.3.8) for CRDP#4 is described. This sub-system is operated by SRON,
Netherlands Institute for Space Research (SRON) and the Karlsruhe Institute for Technology
(KIT). This product is XCO2 generated from GOSAT v201 L1B data using the RemoTeC
algorithm /Butz et al., 2010, 2011/.

This sub-system is an improved version of the sub-system used to generate the CRDP#3
SRFP product (SRFP v2.3.7).

Detailed verification activities have been carried out during sub-system development. These
detailed intermediate verification steps are not reported here. Instead, in this document, end-
to-end verification results are reported. They are based on the following:
 For each CRDP several standard figures have been generated to present an
overview of each corresponding product. End-to-end verification has been conducted
by comparing figures generated for CRDP#4 with the corresponding figures
generated using the previous version of the CRDP, here CRDP#3.
 For product CO2_GOS_SRFP only relatively small changes are expected, except for
the significantly increased number of valid retrievals (see below) and the verification
results shown here confirm that this is the case. No major problems have been
identified when reading and plotting the new CRDP#4 SRFP product. Therefore, the
CO2_GOS_SRFP sub-system used to generate the new CRDP#4 CO2_GOS_SRFP
product is considered to be verified.

Furthermore, initial validation results are also presented in this document. They have been
obtained by comparison with ground-based observations using data products from the
TCCON network /Wunch et al., 2010, 1011/.

Note that a full validation of the CO2_GOS_SRFP CRDP#3 product, which is RemoTeC
version 2.3.8, has not yet been conducted. Full validation results will be available end of
February 2017 (or earlier). The corresponding results will be documented in the “Product
ESA Climate Change Initiative (CCI) Page 6
Version 3.0
System Verification Report (SVR)
GHG-CCI Phase 2 CRDP#4
for sub-system CO2_GOS_SRFP 30 August 2016

for the Essential Climate Variable (ECV)


Greenhouse Gases (GHG)

Validation and Intercomparison Report” (PVIR) for CRDP#4, which will be made available
via the GHG-CCI website. Note that the CRDP#3 results are presented in /GHG-CCI
PVIRv3/.

Note also that the following documents related to the RemoTeC version 2.3.8
CO2_GOS_SRFP CRDP#4 product are also available via the GHG-CCI website:

Algorithm description (ATBD):

/ATBD CRDP#4 RemoTeC v2.3.8/ Hasekamp, O., Algorithm Theoretical Basis Document
Version 5.0 (ATBDv5.0) .
Link: TBD

The ATBD also contains a description of the algorithm changes w.r.t. the previous version
v2.3.7.

Product User Guide (PUG):

/PUG CRDP#4 SRFP v2.3.8/ Detmers, R., Product User Guide Version 4.0 (PUGv4.0) for
the XCO2 Full Physics GOSAT Data Product for the Essential Climate Variable (ECV)
Greenhouse Gases (GHG), 18-August, 2016.
Link: TBD

As explained in the new SRFP PUG, the new SRFP product format has changed to be
compliant with the new GHG-CCI Product Specification Document (PSD):

/PSDv3 GHG-CCI/ Buchwitz, M., Detmers, R., et al., Product Specification Document (PSD)
for the Essential Climate Variable (ECV) Greenhouse Gases (GHG), version 3, 6-June-2014,
2014. Link: http://www.esa-ghg-cci.org/index.php?q=webfm_send/160
ESA Climate Change Initiative (CCI) Page 7
Version 3.0
System Verification Report (SVR)
GHG-CCI Phase 2 CRDP#4
for sub-system CO2_GOS_SRFP 30 August 2016

for the Essential Climate Variable (ECV)


Greenhouse Gases (GHG)

3 Verification
In this section the CRDP#3 CO2_GOS_SRFP sub-system verification method is described,
the verification results are shown and summary and conclusions are given.

3.1 Method
End-to-end verification of the CO2_GOS_SRFP sub-system as used for CRDP#3 is ensured
by comparison of the end results (= final product output files) with the end results of the
previous CRDP, i.e., CRDP#1. The corresponding versions of the RemoTeC algorithm are:
 SRFP version for CRDP#4: v2.3.8
 SRFP version for CRDP#3: v2.3.7

In addition to the product format change (/PUG CRDP#4 SRFP v2.3.8/) the following
algorithm changes had been implemented (see /ATBD CRDP#4 SRFP v2.3.8/):

v2.3.8 changes over v2.3.7


 Use of the reprocessed v201 L1B GOSAT data.
 Adjusted post filtering
 Timeseries extended to Dec 2015 (previously Dec 2014).

3.2 Results
The main verification results are shown in Figure 1.

Figure 1 shows the verification results for different regions.


As can be seen, the new SRFP product (v2.3.8) agrees with the previous version (v2.3.7)
typically within about 0.5 ppm. However for the 2nd half of 2014, there is a distinct jump in the
offset. This is due to a change in the Instrumental Line Shape (ILS) after an incident with the
solar paddle array. We investigated this offset and this change was not taken into account in
the previous version CRDP#3. The new datase, due to the revise, reprocessed V201 data
uses the correct ILS.
ESA Climate Change Initiative (CCI) Page 8
Version 3.0
System Verification Report (SVR)
GHG-CCI Phase 2 CRDP#4
for sub-system CO2_GOS_SRFP 30 August 2016

for the Essential Climate Variable (ECV)


Greenhouse Gases (GHG)

Figure 1: Comparison between CRDP4 and CRDP3 SRFP XCO2 datasets for different
regions. Apart from the offset in mid-2014 the other differences are small. In the NH there is
an offset in summer of 0.5 ppm, possibly the result of the inclusion of a solar zenith angle
bias correction in CRDP4. North Africa also show some variations and a high offset. This is
due to the inclusion of Izana in the gain M bias correction. CRDP#3 had a positive bias for
gain M scenes. As the Izana co-locations include the Sahara region this improved the gain M
bias correction determination significantly.
ESA Climate Change Initiative (CCI) Page 9
Version 3.0
System Verification Report (SVR)
GHG-CCI Phase 2 CRDP#4
for sub-system CO2_GOS_SRFP 30 August 2016

for the Essential Climate Variable (ECV)


Greenhouse Gases (GHG)

3.3 Summary and conclusions

The CO2_GOS_SRFP sub-system used to generate the improved GOSAT XCO2 data
product (v2.3.8) for CRDP#4 has been verified by comparing the output in terms of product
files with the corresponding products of the previous version, i.e., with the CRDP#3
CO2_GOS_SRFP v2.3.7 product.

The following has been found:


 The new product agrees with the specification of the new format as given in PSDv3
and in the new SRFP PUG and can be read in without any problems
 As expected, the XCO2 differences compared to the previous version are relatively
small, less than 0.5 ppm (except for mid 2014 as mentioned)

In summary, no obvious problems have been identified for the new SRFP product and the
differences to the previous version are roughly as expected. The new CO2_GOS_SRFP
sub-system used to generate the new SRFP v2.3.8 product is therefore considered to be
verified.

To what extent the new version is better than the previous version still needs to be
assessed, e.g., via detailed comparisons with ground-based reference data.

Initial validation results are however already available and shown in the following section.
ESA Climate Change Initiative (CCI) Page 10
Version 3.0
System Verification Report (SVR)
GHG-CCI Phase 2 CRDP#4
for sub-system CO2_GOS_SRFP 30 August 2016

for the Essential Climate Variable (ECV)


Greenhouse Gases (GHG)

4 Initial validation
Figures 4-8 show the TCCON vs GOSAT validation for gain H, gain M and sunglint
measurements. As can be seen, the results are similar as the results of the previous version
v2.3.7 as shown in /GHG-CCI PVIRv3/ (e.g., PVIRv3 Fig. 6.1.1.6). However in general the
standard deviation for gain H is slightly larger for most of the TCCON stations, although also
the number of co-locations is more than double that of v2.3.7. Also, the TCCON data were
adjusted for the ghost sampling issue according to the most recent suggestions on the
TCCON website(https://tccon-
wiki.caltech.edu/Network_Policy/Data_Use_Policy/Data_Description)
The station to station standard deviation went slightly up from ppm to ppm.
This is most likely due to the additional co-location pairs from the new FPv2.3.8 data.

TCCON site Number of Mean Standard


co-locations difference deviation of
[-] [ppm] difference
[ppm]
Bialystok, Poland 1419 -0.13 2.08
Bremen, Germany 535 0.16 1.89
Darwin, Australia 4831 0.07 1.58
Garmisch, Germany 723 0.33 2.22
Karlsruhe, Germany 1028 0.19 2.12
Lamont, USA 7896 -0.40 1.77
Lauder, New Zealand 111 1.24 3.26
Orleans, France 1013 -0.03 2.08
Park Falls, USA 3398 0.23 1.96
Saga, Japan 438 0.67 2.12
Sodankyla, Finland 298 0.91 1.93
Wolllongong, Australia 2994 0.21 2.03
TOTAL 24684 0.02 1.91
Table 1: Initial validation results for SRFP XCO2 v2.3.8 Gain H (see /ATBD CRDP#4 SRFP
v2.3.8/ for details).
ESA Climate Change Initiative (CCI) Page 11
Version 3.0
System Verification Report (SVR)
GHG-CCI Phase 2 CRDP#4
for sub-system CO2_GOS_SRFP 30 August 2016

for the Essential Climate Variable (ECV)


Greenhouse Gases (GHG)

TCCON site Number of Mean Standard


co-locations difference deviation of
[-] [ppm] difference
[ppm]
Darwin, Australia 187 0.18 1.31
Dryden, USA 225 -0.69 2.03
Izana 411 0.03 1.79
Wolllongong, Australia 1052 0.06 1.59
TOTAL 1875 -0.01 1.69
Table 2: Initial validation results for SRFP XCO2 v2.3.8 Gain M (see /ATBD CRDP#4 SRFP
v2.3.8/ for details).

TCCON site Number of Mean Standard


co-locations difference deviation of
[-] [ppm] difference
[ppm]
Ascension Island 705 0.03 1.36
Darwin, Australia 453 -0.34 1.26
Reunion Island 727 0.16 1.26
Wolllongong, Australia 205 -0.25 1.46
TOTAL 2090 -0.01 1.33
Table 3: Initial validation results for SRFP XCO2 v2.3.8 Sunglint (see /ATBD CRDP#4
SRFP v2.3.8/ for details).

Figure 6: Comparison of TCCON XCO2 vs GOSAT XCO2 for the different station for gain H
ESA Climate Change Initiative (CCI) Page 12
Version 3.0
System Verification Report (SVR)
GHG-CCI Phase 2 CRDP#4
for sub-system CO2_GOS_SRFP 30 August 2016

for the Essential Climate Variable (ECV)


Greenhouse Gases (GHG)

Figure 7: Same as Fig 10, but for gain M

Figure 8: Same as Fig 10, but for sunglint.


ESA Climate Change Initiative (CCI) Page 13
Version 3.0
System Verification Report (SVR)
GHG-CCI Phase 2 CRDP#4
for sub-system CO2_GOS_SRFP 30 August 2016

for the Essential Climate Variable (ECV)


Greenhouse Gases (GHG)

5 References
/ATBD CRDP#4 SRFP v2.3.8/ Hasekamp, O., Algorithm Theoretical Basis Document
Version 5 (ATBDv5) -.
Link:
/Buchwitz et al., 2013/ Buchwitz, M., M. Reuter, O. Schneising, H. Boesch, S. Guerlet, B.
Dils, I. Aben, R. Armante, P. Bergamaschi, T. Blumenstock, H. Bovensmann, D. Brunner, B.
Buchmann, J. P. Burrows, A. Butz, A. Chédin, F. Chevallier, C. D. Crevoisier, N. M.
Deutscher, C. Frankenberg, F. Hase, O. P. Hasekamp, J. Heymann, T. Kaminski, A. Laeng,
G. Lichtenberg, M. De Mazière, S. Noël, J. Notholt, J. Orphal, C. Popp, R. Parker, M.
Scholze, R. Sussmann, G. P. Stiller, T. Warneke, C. Zehner, A. Bril, D. Crisp, D. W. T.
Griffith, A. Kuze, C. O’Dell, S. Oshchepkov, V. Sherlock, H. Suto, P. Wennberg, D. Wunch,
T. Yokota, Y. Yoshida, The Greenhouse Gas Climate Change Initiative (GHG-CCI):
comparison and quality assessment of near-surface-sensitive satellite-derived CO 2 and CO2
global data sets, Remote Sensing of Environment, doi:10.1016/j.rse.2013.04.024, pp. 19, (in
press), 2013.

/Buchwitz et al., 2011/ Buchwitz, M., F. Chevallier, P. Bergamaschi, I. Aben, H. Bösch, O.


Hasekamp, J. Notholt, M. Reuter, et al., User Requirements Document for the GHG-CCI
project of ESA’s Climate Change Initiative, pp. 45, version 1, 3. February 2011, available on
the GHG-CCI website http://www.esa-ghg-cci.org/ -> Documents or directly via
http://www.esa-ghg-cci.org/sites/default/files/documents/public/documents/URDv1_GHG-
CCI_final.pdf.
/GCOS 2011/ Global Climate Observing System (GCOS), SYSTEMATIC OBSERVATION
REQUIREMENTS FOR SATELLITE-BASED DATA PRODUCTS FOR CLIMATE, 2011
Update, Supplemental details to the satellite-based component of the “Implementation Plan
for the Global Observing System for Climate in Support of the UNFCCC (2010 Update)”,
December 2011, GCOS – 154, 2011.
/GHG-CCI PVIRv3/ Notholt, J., et al., Product Validation and Intercomparison Report (PVIR)
for the Essential Climate Variable (ECV) Greenhouse Gases (GHG), Technical Report,
version 2.0, 4 Nov. 2013, 2013. Link: http://www.esa-ghg-cci.org/index.php?q=webfm_send/152
/PUG CRDP#4 SRFP v2.3.8/ Detmers, R., Product User Guide Version 4 (PUGv4) for the
XCO2 GOSAT Data Product SRFP for the Essential Climate Variable (ECV) Greenhouse
Gases (GHG), 10-June-2014, 2014.
Link:
/PSDv3 GHG-CCI/ Buchwitz, M., Detmers, R., et al., Product Specification Document (PSD)
for the Essential Climate Variable (ECV) Greenhouse Gases (GHG), version 3, 6-June-2014,
2014. Link: http://www.esa-ghg-cci.org/index.php?q=webfm_send/160 ..
/Wunch et al., 2010/ Wunch, D., Toon, G. C., Wennberg, P. O., Wofsy, S. C., Stephens, B.
B., Fischer, M. L., Uchino, O., Abshire, J. B., Bernath, P., Biraud, S. C., Blavier, J.-F. L.,
Boone, C., Bowman, K. P., Browell, E. V., Campos, T., Connor, B. J., Daube, B. C.,
Deutscher, N. M., Diao, M., Elkins, J. W., Gerbig, C., Gottlieb, E., Griffith, D. W. T., Hurst, D.
ESA Climate Change Initiative (CCI) Page 14
Version 3.0
System Verification Report (SVR)
GHG-CCI Phase 2 CRDP#4
for sub-system CO2_GOS_SRFP 30 August 2016

for the Essential Climate Variable (ECV)


Greenhouse Gases (GHG)

F., Jimenez, R., Keppel-Aleks, G., Kort, E. A., Macatangay, R., Machida, T., Matsueda, H.,
Moore, F., Morino, I., Park, S., Robinson, J., Roehl, C. M., Sawa, Y., Sherlock, V., Sweeney,
C., Tanaka, T., and Zondlo, M. A.: Calibration of the Total Carbon Column Observing
Network using aircraft profile data, Atmos. Meas. Tech., 3, 1351–1362, doi:10.5194/amt-3-
1351-2010, 2010.
/Wunch et al., 2011/ Wunch, D., Wennberg, P. O., Toon, G. C., Connor, B. J., Fisher, B.,
Osterman, G. B., Frankenberg, C., Mandrake, L., O’Dell, C., Ahonen, P., Biraud, S. C.,
Castano, R., Cressie, N., Crisp, D., Deutscher, N. M., Eldering, A., Fisher, M. L., Griffith, D.
W. T., Gunson, M., Heikkinen, P., Keppel-Aleks, G., Kyro, E., Lindenmaier, R., Macatangay,
R., Mendonca, J., Messerschmidt, J., Miller, C. E., Morino, I., Notholt, J., Oyafuso, F. A.,
Rettinger, M., Robinson, J., Roehl, C. M., Salawitch, R. J., Sherlock, V., Strong, K.,
Sussmann, R., Tanaka, T., Thompson, D. R., Uchino, O., Warneke, T., and Wofsy, S. C.: A
method for evaluating bias in global measurements of CO 2 total columns from space, Atmos.
Chem. Phys., 11, 20899–20946, doi:10.5194/acpd-11-20899-2011, 2011.
ESA Climate Change Initiative (CCI) Page 15
Version 3.0
System Verification Report (SVR)
GHG-CCI Phase 2 CRDP#4
for sub-system CO2_GOS_SRFP 30 August 2016

for the Essential Climate Variable (ECV)


Greenhouse Gases (GHG)

6 Acronyms
Abbreviation Meaning
ACA Additional Constraints Algorithm (of GHG-CCI)

ATBD Algorithm Theoretical Basis Document

BESD Bremen optimal EStimation DOAS


CCI Climate Change Initiative
CRDP Climate Research Data Package
ECA ECV Core Algorithm (of GHG-CCI)
ECV Essential Climate Variable
EMMA Ensemble Median Algorithm
ESA European Space Agency
FCDR Fundamental Climate Data Record
FP Full Physics
FTIR Fourier Transform InfraRed
FTS Fourier Transform Spectrometer
GCOS Global Climate Observing System
GHG GreenHouse Gas
GMES Global Monitoring for Environment and Security
IPCC International Panel in Climate Change
IUP Institute of Environmental Physics (IUP) of the University of
Bremen, Germany
NOAA National Oceanic and Atmospheric Administration
OCO Orbiting Carbon Observatory
OE Optimal Estimation
PBL Planetary Boundary Layer
PR PRoxy algorithm
ESA Climate Change Initiative (CCI) Page 16
Version 3.0
System Verification Report (SVR)
GHG-CCI Phase 2 CRDP#4
for sub-system CO2_GOS_SRFP 30 August 2016

for the Essential Climate Variable (ECV)


Greenhouse Gases (GHG)

PUG Product User Guide


PVIR Product Validation and Intercomparison Report
RTM Radiative transfer model
SCIATRAN Radiative transfer model for SCIAMACHY developed and
continuously improved at IUP
SCIAMACHY SCanning Imaging Absorption spectroMeter for Atmospheric
CHartograghY
TBC To be confirmed
TCCON Total Carbon Column Observing Network
TBD To be defined / to be determined
VMR Volume Mixing Ratio

End of document

You might also like