Semiparametric deconvolution with unknown noise variance

Matias, Catherine

ESAIM: Probability and Statistics, Tome 6 (2002), pp. 271-292.

Ce travail porte sur l’estimation semi-paramétrique dans un modèle de convolution, où le bruit suit une loi gaussienne centrée de variance ${\sigma }^2$ inconnue. Les modèles non-paramétriques de convolution, où la loi du bruit est entièrement connue, ont été largement étudiés, et il s’avère que la vitesse d’estimation de la densité $g$ du signal est d’autant plus lente que la loi du bruit est régulière [3]. Cependant, la régularité imposée sur $g$ permet d’améliorer ces vitesses d’estimation [15]. Dans cet article, nous montrons que lorsque la loi du bruit (qui est supposée gaussienne centrée) possède une variance ${\sigma }^2$ inconnue (ce qui en pratique est toujours le cas), les vitesses d’estimation de la densité $g$ du signal sont dégradées par rapport au cas où la loi du bruit est entièrement connue. Plus précisemment, se restreindre à des densités régulières pour le signal n’améliore pas la vitesse d’estimation de $g$ qui est toujours plus lente que ${(logn)}^{-1}$. Nous construisons alors deux estimateurs de la variance, dont un consistant dès que le signal a un moment d’ordre $1$ fini. Nous mentionnons enfin une conséquence de ce travail qui est la détérioration des vitesses d’estimation des paramètres dans un modèle de régression non-linéaire avec erreurs sur les variables.

This paper deals with semiparametric convolution models, where the noise sequence has a gaussian centered distribution, with unknown variance. Non-parametric convolution models are concerned with the case of an entirely known distribution for the noise sequence, and they have been widely studied in the past decade. The main property of those models is the following one: the more regular the distribution of the noise is, the worst the rate of convergence for the estimation of the signal’s density $g$ is [3]. Nevertheless, regularity assumptions on the signal density $g$ improve those rates of convergence [15]. In this paper, we show that when the noise (assumed to be gaussian centered) has a variance ${\sigma }^2$ that is unknown (actually, it is always the case in practical applications), the rates of convergence for the estimation of $g$ are seriously deteriorated, whatever its regularity is supposed to be. More precisely, the minimax risk for the pointwise estimation of $g$ over a class of regular densities is lower bounded by a constant over $logn$. We construct two estimators of ${\sigma }^2$, and more particularly, an estimator which is consistent as soon as the signal has a finite first order moment. We also mention as a consequence the deterioration of the rate of convergence in the estimation of the parameters in the nonlinear errors-in-variables model.

Classification : 62G05, 62G07, 62C20
Mots clés : convolution, deconvolution, density estimation, mixing distribution, normal mean mixture model, semiparametric mixture model, noise, variance estimation, minimax risk

[1] R.J. Carroll and P. Hall, Optimal rates of convergence for deconvolving a density. J. Amer. Statist. Assoc. 83 (1988) 1184-1186. | MR | Zbl

[2] L. Devroye, Consistent deconvolution in density estimation. Canad. J. Statist. 17 (1989) 235-239. | MR | Zbl

[3] J. Fan, Asymptotic normality for deconvolution kernel density estimators. Sankhya Ser. A 53 (1991) 97-110. | MR | Zbl

[4] J. Fan, Global behavior of deconvolution kernel estimates. Statist. Sinica 1 (1991) 541-551. | MR | Zbl

[5] J. Fan, On the optimal rates of convergence for nonparametric deconvolution problems. Ann. Statist. 19 (1991) 1257-1272. | MR | Zbl

[6] J. Fan, Adaptively local one-dimensional subproblems with application to a deconvolution problem. Ann. Statist. 21 (1993) 600-610. | MR | Zbl

[7] W. Feller, An introduction to probability theory and its applications, Vol. II. John Wiley & Sons Inc., New York (1971). | MR | Zbl

[8] R.D. Gill and B.Y. Levit, Applications of the Van Trees inequality: A Bayesian Cramér-Rao bound. Bernoulli 1 (1995) 59-79. | MR | Zbl

[9] H. Ishwaran, Information in semiparametric mixtures of exponential families. Ann. Statist. 27 (1999) 159-177. | MR | Zbl

[10] B.G. Lindsay, Exponential family mixture models (with least-squares estimators). Ann. Statist. 14 (1986) 124-137. | MR | Zbl

[11] M.C. Liu and R.L. Taylor, A consistent nonparametric density estimator for the deconvolution problem. Canad. J. Statist. 17 (1989) 427-438. | MR | Zbl

[12] C. Matias and M.-L. Taupin, Minimax estimation of some linear functionals in the convolution model, Manuscript. Université Paris-Sud (2001). | Zbl

[13] P. Medgyessy, Decomposition of superposition of density functions on discrete distributions. II. Magyar Tud. Akad. Mat. Fiz. Oszt. Közl. 21 (1973) 261-382. | MR | Zbl

[14] M.H. Neumann, On the effect of estimating the error density in nonparametric deconvolution. J. Nonparametr. Statist. 7 (1997) 307-330. | MR | Zbl

[15] M. Pensky and B. Vidakovic, Adaptive wavelet estimator for nonparametric density deconvolution. Ann. Statist. 27 (1999) 2033-2053. | MR | Zbl

[16] L. Stefanski and R.J. Carroll, Deconvoluting kernel density estimators. Statistics 21 (1990) 169-184. | MR | Zbl

[17] L.A. Stefanski, Rates of convergence of some estimators in a class of deconvolution problems. Statist. Probab. Lett. 9 (1990) 229-235. | MR | Zbl

[18] M.L. Taupin. Semi-parametric estimation in the non-linear errors-in-variables model. Ann. Statist. 29 (2001) 66-93. | MR | Zbl

[19] A.W. Van Der Vaart, Asymptotic statistics. Cambridge University Press, Cambridge (1998). | MR | Zbl

[20] A.W. Van Der Vaart and J.A. Wellner, Weak convergence and empirical processes. Springer-Verlag, New York (1996). With applications to statistics. | MR | Zbl

[21] C.-H. Zhang, Fourier methods for estimating mixing densities and distributions. Ann. Statist. 18 (1990) 806-831. | MR | Zbl