Estimation of probability density and distribution functions

First- and second-order stochastic gradient algorithms are developed for suitably approximating the unknown density and distribution functions of a random vector from a sequence of independent samples. The mean-square-error criterion and the integral-square-error criterion are used in the approximations. The rates of convergence and the approximation error are also evaluated.