Professional Documents
Culture Documents
Zhi Xiyang
Zhang Wei
Sun Xuan
Wang Dawei
Abstract. We propose an in-orbit modulation transfer function (MTF) statistical estimation algorithm based on
natural scene, called SeMTF. The algorithm can estimate the in-orbit MTF of a sensor from an image without
specialized targets. First, the power spectrum of a satellite image is analyzed, then a two-dimensional (2-D)
fractal Brownian motion model is adopted to represent the natural scene. The in-orbit MTF is modeled by a
parametric exponential function. Subsequently, the statistical model of satellite imaging is established.
Second, the model is solved by the improved profile-likelihood function method. In order to handle the nuisance
parameter in the profile-likelihood function, we divided the estimation problem into two minimization problems for
the parameters of the MTF model and nuisance parameters, respectively. By alternating the two iterative min-
imizations, the result will converge to the optimal MTF parameters. Then the SeMTF algorithm is proposed.
Finally, the algorithm is tested using real satellite images. Experimental results indicate that the estimation
of MTF is highly accurate. © 2015 Society of Photo-Optical Instrumentation Engineers (SPIE) [DOI: 10.1117/1.OE.54.11.113108]
Keywords: inorbit modulation transfer function estimation; natural scenes; parametric exponential function; profile-likelihood function.
Paper 151038 received Jul. 28, 2015; accepted for publication Oct. 20, 2015; published online Nov. 24, 2015.
*Address all correspondence to: Zhi Xiyang, E-mail: zhixiyang@hit.edu.cn 0091-3286/2015/$25.00 © 2015 SPIE
similar to the exponential function.16 Therefore, we adopt the where y denotes the observed image, h is the PSF of the im-
same framework as BLINDE to estimate the exponential aging system, ⊗ denotes the convolution operator, X is the
MTF. The statistical imaging model is constructed. The original image, and N is the zero-mean white Gaussian noise.
improved profile likelihood function is proposed to invert In the Fourier domain, Eq. (3) can also be written as fol-
the model to estimate the MTF’s parameters. Finally, the pro- lows:
posed MTF estimation algorithm is analyzed and verified
using real satellite images. Ỹ ¼ X̃ × MTF þ Ñ;
EQ-TARGET;temp:intralink-;e004;326;697 (4)
2 In-Orbit Modulation Transfer Function Statistical where Ỹ, X̃, and Ñ are the respective Fourier transforms of Y,
Estimation Model X, and N. MTF is the modulation transfer function, which is
the Fourier transform magnitude of the PSF, MTF ¼ jF ½hj.
2.1 Modeling of Natural Scenes The phase transfer function (PTF) is often ignored due to the
Previous work has shown that the power spectrum of the fact that the PSF in the satellite imaging process is symmet-
natural scene image exhibits scale-invariance properties. rical. Thus, the PSP h is the inverse Fourier transform of
Intuitively, such properties mean that the scaled image is MTF, or h ¼ F −1 ½MTF. Therefore, Eq. (3) can be rewritten
similar to the unscaled image, thus it is also called self-sim- as
ilarity.17 From a statistical sense, scale invariance implies that
rescaling objects does not affect the measured statistics. Y ¼ X ⊗ F −1 ½MTF þ N: (5)
Let X denotes the natural scenery, then the spatial
EQ-TARGET;temp:intralink-;e005;326;577
frequencies are normalized into ½−0.5; 0.5 by the Nyquist In most cases, N ∼ N ð0; σ 2 Þ. Hence, the likelihood func-
frequency, and normalized p spatial frequencies are still
ffiffiffiffiffiffiffiffiffiffiffiffiffiffiffi tion can be constructed as follows:
denoted by the ðu; vÞ. Let r ¼ u2 þ v2 denote the distances
between (u, v) and the coordinate origin. The power spectra πðY i;j jX; MTF; σ 2 Þ ¼ N Y i;j f½X ⊗ F −1 ðMTFÞipx ;jpy ; σ 2 g;
of images with scale-invariance properties satisfy the follow-
EQ-TARGET;temp:intralink-;e006;326;524
where
2.2 Modeling of Modulation Transfer Function
Parametric Estimation 1
Ñ x̃ ðμ̃; σ 2 Þ ¼ expf−½Reðx̃ − μ̃Þ2 − ½Imðx̃ − μ̃Þ2 g:
2πσ 2
EQ-TARGET;temp:intralink-;e010;326;192
Fig. 1 Satellite images and corresponding power spectra: (a) CBERS satellite image and its power spec-
trum, (b) ZY-3 satellite image and its power spectrum, and (c) GF-2 satellite image and its power
spectrum.
Y
πðỸjw0 ; q; MTF; σ 2 Þ ¼
EQ-TARGET;temp:intralink-;e011;326;260 Ñ Ỹ kl ð0; w20 r−2q 2 2
uv MTFuv þ σ Þ:
kl
(11)
Fig. 2 Distribution of exponential-type modulation transfer function We substitute Eq. (10) into Eq. (9), then the parametric
(MTF). estimation model of MTF can be written as
Y
We should note that the differences between λ and α are
EQ-TARGET;temp:intralink-;e013;63;752
∂LðỸjα;λ0 Þ
; (20)
lihood function, we rewrite Eq. (11) as the negative loga- ∂αv
rithm-likelihood function
LðỸjα; w0 ; qÞ ¼ − log πðỸjw0 ; q; α; σ 2 Þ
EQ-TARGET;temp:intralink-;e014;63;580
X w0 r−2q
∂LðỸjα; λÞ uv MTFuv
2 jỸ kl j2 t ¼ t þ 1;
¼2 1 − ; (16)
∂w0 ω2kl 2ω2kl
EQ-TARGET;temp:intralink-;e016;63;340
2 3
The minimization in Eq. (19) can also be solved with the ∂2 LðỸjα;λÞ ∂2 LðỸjα;λÞ
2 ∂w0 ∂q 5
conjugate gradient algorithm, where the gradient term ∇2λ LðỸjα0 ; λÞ ¼ 4 2 ∂ω0 ; (23)
∂ LðỸjα;λÞ ∂2 LðỸjα;λÞ
EQ-TARGET;temp:intralink-;e023;326;675
∇λ LðỸjα0 ; λÞ can be calculated from Eqs. (16) and (17). ∂q∂w0 ∂q2
However, the conjugate gradient algorithm requires hun-
dreds of iterations to obtain the optimal result. Therefore,
we employ the Newton algorithm with the second order where
8
>
> 2 X ruv −2q −2q
MTF2uv ð2ω4kl − jỸ kl j2 ω2kl − 4w20 ruv MTF2uv ω2kl þ 4w20 r−2q 2 2
uv MTFuv jỸ kl j Þ
> ∂ LðỸjα; λÞ ¼
>
>
>
>
> ∂ω20 ω6kl
>
>
kl
>
> ∂2 LðỸjα; λÞ X 2w0 logðruv Þruv MTF2uv ð2ω2 σ 2 − jỸ kl j2 ω2 þ 2w2 r−2q
−2q 2 2
>
> kl kl 0 uv MTFuv jỸ kl j Þ
< ¼− 6
∂w0 ∂q ωkl
kl : (24)
>
> ∂ 2
Lð Ỹjα; λÞ ∂2
Lð Ỹjα; λÞ
EQ-TARGET;temp:intralink-;e024;63;576
>
> ¼
>
> ∂q∂w0 ∂w0 ∂q
>
>
>
> 2 LðỸjα; λÞ X 2w0 logðruv Þr−2q 2 2 2 2 2 2 −2q 2 2
>
> ∂ uv MTFuv ð2ωkl σ − jỸ kl j ωkl þ 2w0 ruv MTFuv jỸ kl j Þ
>
> ¼
: ∂q2 ω6kl
kl
It should be noted that usually calculating the inverse 3.3 Algorithm Implementation
Hessian matrix is computationally extensive; however, We propose an in-orbit MTF statistical estimation algorithm
∇2λ LðỸjα0 ; λÞ is only a 2 × 2 matrix, and its inverse can based on natural images, termed the SeMTF algorithm (stat-
be easily calculated. istical estimation of in-orbit MTF), and it consists of the fol-
lowing steps (see Fig. 3):
3.2 Noise Variance Estimation 1. Estimating the noise variance σ^ 2 from the observed
The noise is a key parameter in our estimation, and it should image Y and giving initial value αð0Þ .
be estimated from the image. According to the above analy- 2. SubstitutingY, σ^ 2 , and αðkÞ into the min-Lamda algo-
sis, satellite images satisfy the power spectrum model of rithm to get parameter λðkþ1Þ.
Eq. (1), and this means that the image energy decreases 3. Putting λðkþ1Þ into the min-Alpha algorithm to obtain
with a spatial frequency increase. Gaussian white noise αðkþ1Þ , together with Y and σ^ 2 .
is approximately constant over its power spectrum.
Therefore, the noise can be estimated at high frequencies
of the image’s power spectrum. The high-pass filter is
used to filter out the low-frequency portion of the images.
The noise variance is then computed from the filtered
image.22 In this paper, we adopt the Laplace high-pass filter,
which can be written as
2 3
1 −2 1
Lp ¼ 4 −2
EQ-TARGET;temp:intralink-;e025;63;230 4 −2 5. (25)
1 −2 1
1 X
σ^ 2 ¼ ðY ⊗ LpÞ2 : (26)
ELp · ðN x N y Þ ij i;j
EQ-TARGET;temp:intralink-;e026;63;130
Fig. 4 Real satellite images: (a) CBERS satellite image, (b) ZY-3 satellite image, (c) GF-2 satellite image,
and (d) CH-1 satellite image.
4. Iterate alternatively between the min-Lamda algorithm experiments are performed on each tested image. The tested
and min-Alpha algorithm until the result meets the results are shown in Table 1. In order to show the impact of
final convergence criteria, obtaining the final estima- the estimated parameters on the MTF curve, Table 1 shows
^
tion result α. the MTF values when ðu; vÞ is (0.5, 0), (0, 0.5), and (0.5,
0.5), respectively.
Table 2 lists the estimated results of MTF at the Nyquist
4 Experiments
frequency in the 95% confidence interval. As one can easily
4.1 Experimental Design observe, the confidence interval covers the real MTF. This
In this section, a series of experiments are performed to illus-
trate the performance of the SeMTF algorithm. In order to
assess the performance of the SeMTF algorithm, the test
data are from CBERS, ZY-3, GF-2, and CH-1 satellite
image data. Figure 4 shows the three test images that are
selected in this paper. To eliminate the blur presented in
these satellite images, we downsampled the original image
two times.
Generally, the MTF of an in-orbit imaging system is
around 0.1 at the Nyquist frequency. In the experiments,
we consider two cases: α ¼ 20 (MTF ¼ 0.1) and α ¼ 50
(MTF ¼ 0.03), where the distribution of MTF is shown in
Fig. 5. In addition, we consider two noise levels, where
σ 2 is 2 × 10−3 and 4 × 10−3 , respectively.
MTF
Table 2 95% confidence interval of estimated MTF at Nyquist 2. K. Bensebaa, G. J. Banon, and L. M. Fonseca, “On orbit spatial res-
frequency. olution estimation of CBERS-1 CCD camera,” in IEEE First Symp. on
Multi-Agent Security and Survivability, pp. 576–579, IEEE (2004).
3. H. F. Gu et al., “MTF compensation and measurement of CBERS-02
CCD camera,” Sci. China Ser. E Inf. Sci. 35, 26–40 (2005).
MTF parameters (MTF at 4. T. Choi, IKONOS Satellite on Orbit Modulation Transfer Function
Nyquist frequency) u-direction v -direction (MTF) Measurement using Edge and Pulse Method, South Dakota
State University, South Dakota (2002).
20 (0.1069) 0.0936 0.0247 0.106 0.0404 5. R. A. Schowengerdt, Remote Sensing: Models and Methods for Image
Processing, pp. 1–353, Academic Press, New York (2007).
50 (0.0291) 0.0234 0.0094 0.0274 0.0137 6. P. Campisi and K. Egiazarian, Blind Image Deconvolution Theory and
Applications, pp. 239–271, CRC Press, New York (2007).
7. G. R. Ayers and J. C. Dainty, “Iterative blind deconvolution method
and its applications,” Opt. Lett. 13(7), 547–549 (1988).
8. D. Kundur and D. Hatzinakos, “A novel blind deconvolution scheme
demonstrates that the SeMTF algorithm can effectively esti- for image restoration using recursive filtering,” IEEE Trans. Signal
mate the MTF parameters and has high accuracy. Process. 46(2), 375–390 (1998).
9. D. Kundur and D. Hatzinakos, “Blind image deconvolution,” IEEE
In addition, we can find the following conclusions from Signal Process. Mag. 13, 43–64 (1996).
Table 1: 10. T. F. Chan and C. Wong, “Total variation blind deconvolution,” IEEE
Trans. Image Process. 7(3), 370–375 (1998).
11. R. Molina, J. Mateos, and A. K. Katsaggelos, “Blind deconvolution
1. For the same MTF parameters, a larger noise variance using a variational approach to parameter, image, and blur estimation,”
results in a lower estimation accuracy. In fact, the noise IEEE Trans. Image Process. 15(12), 3715–3727 (2006).
destroys the scale-invariance property of the natural 12. S. D. Babacan, R. Molina, and A. K. Katsaggelos, “Variational
Bayesian blind deconvolution using a total variation prior,” IEEE
scene and decreases the useful frequency band from Trans. Image Process. 18(1), 12–26 (2009).
which the MTF is estimated. 13. J. Delvit et al., “Modulation transfer function and noise assessment,”
Proc. 2003 IEEE Int. Geoscience and Remote Sensing Symp. (IGARSS
2. For the same noise variance, higher MTF parameters 03), Vol. 7, pp. 4500–4502 (2003).
result in higher estimation accuracy. This is mainly 14. J. Delvit et al., “Modulation transfer function estimation from nonspe-
cific images,” Opt. Eng. 43(6), 1355–1365 (2004).
because the MTF with high parameters has more 15. A. Jalobeanu, Models, Bayesian Estimation and Algorithms of Remote
impact on the power spectrum of the degraded Sensing Images, l’Université de Nice-Sophia Antipolis (2001).
image than the natural scene, from which the MTF 16. Y. Zeng, S. P. Chen, and J. Yu, “Modulation transfer function compen-
sation technology of optical remote sensing imaging system,” Chin.
can be easily estimated. Space Sci. Techn. 30(4), 38–43 (2010).
17. D. L. Ruderman, “Origins of scaling in natural images,” Vision Res.
37(23), 3385–3398 (1997).
5 Conclusion 18. A. Jalobeanua, L. Blanc-Feraud, and J. Zerubiab, “Natural image mod-
eling using complex wavelets,” Proc. SPIE 5207, 480–494 (2003).
The main contribution of this paper is to put forward an in- 19. G. Wornell, Signal Processing with Fractals: a Wavelet-based
orbit MTF statistical estimation algorithm based on the natu- Approach, pp. 30–71, Prentice Hall, Upper Saddle River (1996).
20. B. Liseo, “The elimination of nuisance parameters,” Handbook Stat.
ral images called SeMTF. The algorithm can estimate MTF 25, 193–219 (2005).
from the degraded image only, not requiring any specified 21. N. Reid and D. A. S. Fraser, “Likelihood inference in the presence of
targets embodied in the image. In order to solve the coupled nuisance parameters,” arXiv preprint Physics, 0312079 (2003).
22. S. Tai and S. Yang, “A fast method for image noise estimation using
problem between the MTF and the scene in the observed Laplacian operator and adaptive edge detection,” 3rd Int. Symp.
image, a two-dimension fractal Brownian motion model is Communications, Control and Signal Processing (ISCCSP 2008),
pp. 1077–1081 (2008).
adopted to model the natural scene, and a parametric
model of MTF is established. The exponential function is
Zhi Xiyang is an assistant professor at the Research Center for
adopted to model the MTF according to the actual form Space Optics Engineering of Harbin Institute of Technology (HIT).
of the in-orbit MTF. Then the statistical model of satellite He received his PhD in the Department of Optical Engineering,
imaging is constructed based on the above models, and HIT. His current research interests include optimization of imaging
the model is solved by the improved profile-likelihood func- system design, remote sensing image processing, and image quality
assessment technology.
tion method. Finally, the MTF estimation algorithm is pro-
posed. Experimental results demonstrate the high accuracy Zhang Wei is a professor at the Research Center for Space Optics
of the algorithm; it can be applied to perform a blind Engineering of Harbin Institute of Technology (HIT). His current
deconvolution. research interests in photoelectric image acquisition and processing.