Computational Methods for Measuring the Difference of Empirical Distributions

Abstract This paper presents a simple computational method for measuring the difference of independent empirical distributions estimated by bootstrapping or other resampling approaches. Using data from a field test of external scope in contingent valuation, this complete combinatorial method is compared with other methods (empirical convolutions, repeated sampling, normality, nonoverlapping confidence intervals) that have been suggested in the literature. Tradeoffs between methods are discussed in terms of programming complexity, time and computer resources required, bias, and the precision of the estimate.