Improved dynamic programing procedures and their practical application to water resource systems

An optimization algorithm is described that uses value iteration dynamic programing and simulation in conjunction with penalty costs to derive long‐term operating policies for water resource systems. Very efficient value iteration procedures are developed for two types of problems, illustrated by numerical examples. An indication is given of how the methods described can be applied to multireservoir systems by using the concept of an equivalent reservoir.