Ultra-high dimensional variable screening via Gram–Schmidt orthogonalization - Cnam - Conservatoire national des arts et métiers
Article Dans Une Revue Computational Statistics Année : 2020

Ultra-high dimensional variable screening via Gram–Schmidt orthogonalization

Résumé

Independence screening procedure plays a vital role in variable selection when the number of variables is massive. However, high dimensionality of the data may bring in many challenges, such as multicollinearity or high correlation (possibly spurious) between the covariates, which results in marginal correlation being unreliable as a measure of association between the covariates and the response. We propose a novel and simple screening procedure called Gram–Schmidt screening (GSS) by integrating the classical Gram–Schmidt orthogonalization and the sure independence screening technique, which takes into account high correlations between the covariates in a data-driven way. GSS could successfully discriminate between the relevant and the irrelevant variables to achieve a high true positive rate without including many irrelevant and redundant variables, which offers a new perspective for screening method when the covariates are highly correlated. The practical performance of GSS was shown by comparative simulation studies and analysis of two real datasets.
Fichier non déposé

Dates et versions

hal-02557084 , version 1 (28-04-2020)

Identifiants

Citer

Huiwen Wang, Ruiping Liu, Shanshan Wang, Zhichao Wang, Gilbert Saporta. Ultra-high dimensional variable screening via Gram–Schmidt orthogonalization. Computational Statistics, 2020, 35, pp.1153-1170. ⟨10.1007/s00180-020-00963-7⟩. ⟨hal-02557084⟩
122 Consultations
0 Téléchargements

Altmetric

Partager

More