Overview of Feature Screening Methods for Ultra-high Dimensional Data
-
-
Abstract
With the improvement of data collection and storage capacity, ultra-high dimensional data\ucite9, that is, dimensionality with the exponential growth of samples appears in many scientific neighborhoods. At this time, penalized variable selection methods generally encounter three challenges: computational expediency, statistical accuracy, and algorithmic stability, which are limited in handling ultra-high dimensional problems. Fan and Lv\ucite9 proposed the method of ultra-high dimensional feature screening, and achieved a lot of research results in the past ten years, which has become the most popular field of research in statistics. This paper mainly introduces the related work of ultra-high dimensional screening method from four aspects: the screening methods with model hypothesis, including parametric, non-parametric and semi-parametric model hypothesis, model-free hypothesis, and screening methods for special data. Finally, we briefly discuss the existing problems of ultra-high dimensional screening methods and some future directions.
-
-