Stein's method and the zero bias transformation with application to simple random sampling

Let W be a random variable with mean zero and variance σ². The distribution of a variate W^*, satisfying EWf(W) = σ² Ef'(W^*) for smooth functions f , exists uniquely and defines the zero bias transformation on the distribution of W. The zero bias transformation shares many interesting properties with the well-known size bias transformation for nonnegative variables, but is applied to variables taking on both positive and negative values. The transformation can also be defined on more general random objects. The relation between the transformation and the expression wf'(w) - σ² f''(w) which appears in the Stein equation characterizing the mean zero, variance σ² normal σ Zcan be used to obtain bounds on the difference Eh(W/ σ) - h(Z) for smooth functions h by constructing the pair (W, W^*) jointly on the same space. When W is a sum of n not necessarily independent variates, under certain conditions which include a vanishing third moment, bounds on this difference of the order $1/n$ for classes of smooth functions h may be obtained. The technique is illustrated by an application to simple random sampling.