Diffusion approximations for load balancing mechanisms in cloud storage systems

In large storage systems, files are often coded across several servers to improve reliability and retrieval speed. We study load balancing under the batch sampling routeing scheme for a network ofnservers storing a set of files using the maximum distance separable (MDS) code (cf. Li (2016)). Specifically, each file is stored in equally sized pieces acrossLservers such that anykpieces can reconstruct the original file. When a request for a file is received, the dispatcher routes the job into thek-shortest queues among theLfor which the corresponding server contains a piece of the file being requested. We establish a law of large numbers and a central limit theorem as the system becomes large (i.e.n→ ∞), for the setting where all interarrival and service times are exponentially distributed. For the central limit theorem, the limit process take values inℓ2, the space of square summable sequences. Due to the large size of such systems, a direct analysis of then-server system is frequently intractable. The law of large numbers and diffusion approximations established in this work provide practical tools with which to perform such analysis. The power-of-drouteing scheme, also known as the supermarket model, is a special case of the model considered here.