Infinite Balanced Allocation via Finite Capacities

We analyze the following infinite load balancing process, modeled as a classical balls-into-bins game: There are
$n$
bins (servers) with a limited capacity (buffer) of size
$c=c(n)\in \mathbb{N}$
. Given a fixed arrival rate
$\lambda=\lambda(n)\in(0,1)$
, in every round
$\lambda n$
new balls (requests) are generated. Together with possible leftovers from previous rounds, these balls compete to be allocated to the bins. To this end, every ball samples a bin independently and uniformly at random and tries to allocate itself to that bin. Each bin accepts as many balls as possible until its buffer is full, preferring balls of higher age. At the end of the round, every bin deletes the ball it allocated first. We study how the buffer size
$c$
affects the performance of this process. For this, we analyze both the number of balls competing each round (including the leftovers from previous rounds) as well as the worst-case waiting time of individual balls. We show that (i) the number of competing balls is at any (even exponentially large) time bounded with high probability by
$4 \cdot c^{-1} \cdot \ln (1/(1-\lambda))\cdot n + \mathrm{O}(c \cdot n)$
and that (ii) the waiting time of a given ball is with high probability at most
$(4 \cdot \ln (1/(1-\lambda)))/ (c \cdot (1-1/e)) + \log \log n + \mathrm{O}(c)$
. These results indicate a sweet spot for the choice of
$c$
around
$c = \Theta(\sqrt{\log (1/(1-\lambda))})$
. Compared to a related process with infinite capacity [Berenbrink et al., PODC'16], for constant
$\lambda$
the waiting time is reduced from
$\mathrm{O}(\log n)$
to
$\mathrm{O}(\log \log n)$
. Even for large
$\lambda \approx 1 - 1/n$
we reduce the waiting time from
$\mathrm{O}(\log n)$
to
$\mathrm{O}(\sqrt{\log n})$
.