Back To Index Previous Article Next Article Full Text

Statistica Sinica 32 (2022), 181-207

ELASTIC-NET REGULARIZED HIGH-DIMENSIONAL
NEGATIVE BINOMIAL REGRESSION:
CONSISTENCY AND WEAK SIGNAL DETECTION

Huiming Zhang1,2 and Jinzhu Jia1

1Peking University and 2University of Macau

Abstract: We study a sparse negative binomial regression (NBR) for count data by showing the non-asymptotic advantages of using the elastic-net estimator. Two types of oracle inequalities are derived for the NBR's elastic-net estimates by using the Compatibility Factor Condition and the Stabil Condition. The second type of oracle inequality is for the random design and can be extended to many 1 + 2 regularized M-estimations, with the corresponding empirical process having stochastic Lipschitz properties. We derive the concentration inequality for the suprema empirical processes for the weighted sum of negative binomial variables to show some high-probability events. We apply the method by showing the sign consistency, provided that the nonzero components in the true sparse vector are larger than a proper choice of the weakest signal detection threshold. In the second application, we show the grouping effect inequality with high probability. Third, under some assumptions for a design matrix, we can recover the true variable set with a high probability if the weakest signal detection threshold is large than the turning parameter up to a known constant. Lastly, we briefly discuss the de-biased elastic-net estimator, and numerical studies are given to support the proposal.

Key words and phrases: De-biased elastic-net, empirical processes, high-dimensional count data regressions, oracle inequalities, sign consistency, stochastic Lipschitz condition.

Back To Index Previous Article Next Article Full Text