Answers are grounded in this paper and cite their sources.
We compare the least squares estimator (LSE) with the ₁-estimator recently introduced by Baraud and Maillard~{BM-2026} for estimating a regression function under a fixed design, when the errors are independent but possibly heteroscedastic and heavy-tailed. We show that the two estimators coincide on the class of nondecreasing (or nonincreasing) functions on an interval. As a consequence, the isotonic LSE inherits the non-asymptotic ₁-risk bounds of the ₁-estimator, which only require a moment of order p∈[1,2] on the errors and depend on the average of their p-th absolute moments rather than on their maximum. This coincidence no longer holds on the nonconvex class of unimodal functions: we exhibit a heteroscedastic Gaussian example in which the LSE is inconsistent while the ₁-estimator converges at the parametric rate. Finally, we show on a one-dimensional linear model that neither estimator dominates the other: depending on the way the noise is distributed among the design points, the LSE may converge at rate $1/n$ while the ₁-estimator is inconsistent.
No takes yet. Share an insight, caveat, or question.
Yannick Baraud (2026) studied this question.
Synapse has enriched 8 closely related papers on similar clinical questions. Consider them for comparative context: