Controlling a Stochastic Process with Unknown Parameters

The problem of controlling a stochastic process, with unknown parameters over an infinite horizon, with discounting is considered. Agents express beliefs about unknown parameters in terms of distributions. Under general conditions, the sequence of beliefs converges to a limit distribution. The limit distribution may or may not be concentrated at the true parameter value. In some cases, complete learning is optimal; in others, the optimal strategy does not imply complete learning. The paper concludes with examination of some special cases and a discussion of a procedure for generating examples in which incomplete learning is optimal. Copyright 1988 by The Econometric Society.