岭回归中确定K值的一种方法

A Method to Determine the Ridge Parameter in Ridge Regression

  • 摘要: 本文给出了岭估计中确定K值的一种新方法,这种方法改进了Hoerl和Kennard的相应方法。

     

    Abstract: In this paper, the author considers linear model Y_n \times 1=X_n \times m \beta_m \times 1+\varepsilon_n \times 1, \quad \mathrmE(Y)=X \beta, \quad \operatornameVar(Y)=\sigma^2 I_n, \quad R(X)=m Its canonical model is Y_n \times 1=Z_n \times m \dot\alpha_m \times 1+\varepsilon_n \times 1,, where Z^\prime Z=\Lambda=\operatornamediag\left(\lambda_1, \cdots, \lambda_m\right), \lambda_1 \geq 0, \cdots, \lambda_m \geq 0 are the eigenvalues of X’X, The ridge estimator of α is \widehat\alpha(k)=(\Lambda+k I)^-1 Z^\prime Y and the ridge estimator of β is P’^ak), where P is orthogonal matrix. So that P’X’XP = ∧. In this paper, a new method to determine ridge parameter k in ridge regression is given. This method has improved the Hoerl-Kennard formula.

     

/

返回文章
返回