Random thresholds for linear model selection
ESAIM: Probability and Statistics, Tome 12 (2008), pp. 173-195.

A method is introduced to select the significant or non null mean terms among a collection of independent random variables. As an application we consider the problem of recovering the significant coefficients in non ordered model selection. The method is based on a convenient random centering of the partial sums of the ordered observations. Based on L-statistics methods we show consistency of the proposed estimator. An extension to unknown parametric distributions is considered. Simulated examples are included to show the accuracy of the estimator. An example of signal denoising with wavelet thresholding is also discussed.

DOI : 10.1051/ps:2007047
Classification : 62F12, 62G05, 62P99
Mots clés : adaptive estimation, linear model selection, hard thresholding, random thresholding, $L$-statistics
@article{PS_2008__12__173_0,
     author = {Lavielle, Marc and Lude\~na, Carenne},
     title = {Random thresholds for linear model selection},
     journal = {ESAIM: Probability and Statistics},
     pages = {173--195},
     publisher = {EDP-Sciences},
     volume = {12},
     year = {2008},
     doi = {10.1051/ps:2007047},
     mrnumber = {2374637},
     language = {en},
     url = {http://www.numdam.org/articles/10.1051/ps:2007047/}
}
TY  - JOUR
AU  - Lavielle, Marc
AU  - Ludeña, Carenne
TI  - Random thresholds for linear model selection
JO  - ESAIM: Probability and Statistics
PY  - 2008
SP  - 173
EP  - 195
VL  - 12
PB  - EDP-Sciences
UR  - http://www.numdam.org/articles/10.1051/ps:2007047/
DO  - 10.1051/ps:2007047
LA  - en
ID  - PS_2008__12__173_0
ER  - 
%0 Journal Article
%A Lavielle, Marc
%A Ludeña, Carenne
%T Random thresholds for linear model selection
%J ESAIM: Probability and Statistics
%D 2008
%P 173-195
%V 12
%I EDP-Sciences
%U http://www.numdam.org/articles/10.1051/ps:2007047/
%R 10.1051/ps:2007047
%G en
%F PS_2008__12__173_0
Lavielle, Marc; Ludeña, Carenne. Random thresholds for linear model selection. ESAIM: Probability and Statistics, Tome 12 (2008), pp. 173-195. doi : 10.1051/ps:2007047. http://www.numdam.org/articles/10.1051/ps:2007047/

[1] F. Abramovich and Y. Benjamini, Adaptive thresholding of wavelet coefficients. CSDA 4 (1996) 351-361. | MR

[2] A. Antoniadis, J. Bigot and T. Sapatinas, Wavelet estimators in nonparametric regression: a comparative simulation study. J. Statist. Software 6 (2001) 1-83.

[3] B. Arnold, N. Balakrishnan and H. Nagaraja, A first course in order statistics. Wiley series in probability (1993). | MR | Zbl

[4] A. Barron, L. Birgé and P. Massart, Risk bounds for model selection via penalization. Probab. Theory Related Fields 113 (1999) 301-413. | MR | Zbl

[5] L. Birgé and P. Massart, Minimal penalties for Gaussian model selection. Probab. Theor. Rel. Fields 138 (2007) 33-73. | MR | Zbl

[6] O. Bousquet, Concentration inequalities for sub-additive functions using the entropy method, in Stochastic inequalities and applications, Progr. Probab. Birkhäuser, Basel 56 (2003) 213-247. | MR | Zbl

[7] T. Cai, Adaptive wavelet estimation: a block thresholding and oracle inequality approach. Ann. Stat. 3 (1999) 898-924. | MR | Zbl

[8] L. De Haan, On regular variation and its application to the weak convergence of sample extremes. 3rd ed., Mathematical Centre Tracts 32 Amsterdam (1975). | Zbl

[9] D. Donoho and J. Jin, Higher criticism for detecting sparse heterogeneous mixtures. Ann. Stat. 32 (2004) 962-994. | MR | Zbl

[10] D. Donoho and I. Johnstone, Ideal spatial adaptation by wavelet shrinkage. Biometrika 81 (1994) 425-455. | MR | Zbl

[11] M. Falk, A note on uniform asymptotic normality of intermidiate order statistics. Ann. Inst. Statist. Math 41 (1989) 19-29. | MR | Zbl

[12] J. Fan and R. Li, Variable selection via nonconcave penalized likelihood and its oracle properties. J. Amer. Statist. Assoc. 96 (2001) 1348-1360. | MR | Zbl

[13] T. Hastie, R. Tibshirani and J. Friedman, The elements of statistical learning. Springer, Series in statistics (2001). | MR | Zbl

[14] N. Meinhausen and J. Rice, Estimating the proportion of false null hypothesis among a large number of independently tested hypothesis. Ann. Stat. 34 (2006) 373-393. | MR | Zbl

[15] M.S. Pinsker, Optimal filtration of square-integrable signals in Gaussian noise. Probl. Peredachi Inform. 2 (1980) 52-68. | MR | Zbl

[16] G. Shorak and J. Wellner, Empirical processes with Applications to Statistics. Wiley (1986). | MR

[17] R. Tibshirani, Regression shrinkage and selection via the lasso. J. Roy. Statist. Soc. B 58 (1996) 267-288. | MR | Zbl

Cité par Sources :