Yeah,This is one case where the buildfarm is less responsive than we'd like. In the future we hope to make the reconfiguring be done on demand with hooks based on commits instead of nightly batches. But we were not able to fit that into our last sprint.