The distribution of the Lasso: Uniform control over sparse balls and adaptive parameter tuning

The Lasso is a popular regression method for high-dimensional problems in the number of parameters \₁, \, \N, is larger than the n of samples: N>n. A useful heuristics relates the statistical of the Lasso estimator to that of a simple soft-thresholding, in a denoising problem in which the parameters (\ᵢ) ₈\ ₍ observed in Gaussian noise, with a carefully tuned variance. Earlier work this picture in the limit n, N\\, pointwise in the parameters\, and in the value of the regularization parameter. Here, we consider a standard random design model and prove exponential of its empirical distribution around the prediction provided by Gaussian denoising model. Crucially, our results are uniform with respect \ belonging to \q balls, q\ 0, 1, and with respect to the parameter. This allows to derive sharp results for the of various data-driven procedures to tune the regularization. Our proofs make use of Gaussian comparison inequalities, and in particular of version of Gordon's minimax theorem developed by Thrampoulidis, Oymak, and, which controls the optimum value of the Lasso optimization problem. , we prove a stability property of the minimizer in Wasserstein, that allows to characterize properties of the minimizer itself.