On minimal error entropy stochastic approximation

Information-theoretic concepts are developed and employed to obtain conditions for a minimax error entropy stochastic approximation algorithm to estimate the state of a non-linear discrete time system baaed on noisy linear measurements of the state. Two recursive suboptimal error entropy estimation procedures are presented along with an upper bound formula for the resulting error entropy. A simple example is utilized to compare the optimal and suboptimal error entropy estimators and the minimum mean Square error linear estimator.