Answers are grounded in this paper and cite their sources.
For kernel regression estimation a weighting scheme due to Nadaraya and Watson has been associated with random design, and a convolution type weighting scheme with fixed design. Based on integrated mean square error, none of the estimators is uniformly optimal in either design. However, the convolution type weights are minimax optimal. Further advantages of this estimator can be seen in the structure of the bias.
No takes yet. Share an insight, caveat, or question.
Gasser et al. (1990) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: