Incrementally rolling out applications to production