Digital adaptive filters: Conditions for convergence, rates of convergence, effects of noise and errors arising from the implementation

A variety of theoretical results are derived for a well-known class of discrete-time adaptive filters. First the following idealized identification problem is considered: a discrete-time system has vector inputx(t)and scalar outputz(t)= h \' x(t)wherehis an unknown time-invariant coefficient vector. The filter considered adjusts an estimate vectorĥ(t)in a control loop according toĥ(t + Δ t) = ĥ(t) + K[z(t) - ẑ (t)]x(t), whereẑ( t)= ĥ( t) \' x( t)andKis the control loop gain. The effectiveness of the filter is determined by the convergence properties of the misalignment vectorr(t) = h - ĥ(t). It is shown that a certain nondegeneracy "mixing" condition on the Input { x(t)} is necessary and sufficient for the exponential convergence of the misalignment. Qualitatively identical upper and lower bounds are derived for the rate of convergence. Situations where noise is present inz(t)andx(t)and the coefficient vectorhis time-varying are analyzed. Nonmixing inputs are also considered, and it is shown that in the idealized model the above stability results apply with only minor modifications. However, nonmixing input in conjunction with certain types of noise lead to bounded input - unbounded output, i.e., instability.