The foundations of finite sample estimation in stochastic processes

The Gauss-Markov theorem on least squares for linear models derives its general applicability because it depends on the underlying distribution only through the first two moments. In this paper, a similar theorem is established within the context of stochastic processes. Various problems of finite sample estimation are solved by application of this theorem.