The Future of Google Testing

As a company with a growing codebase and developer pool, Google’s testing infrastructure is encountering superlinear (with respect to # of tests / size of the codebase) growth in compute cost and latency of breakage signal/release frequency. In order to scale effectively, we are attempting to decrease the number of builds/tests performed at earlier stages while maintaining signal, in order to not negatively impact developer productivity while reducing testing costs. This presentation will explore the paradigm shift occurring in our development workflow / testing cycles and the observed and estimated effects / tradeoffs they represent for Google.