some tests change the environment that they run in to the point that subsequent tests can no longer run there - e.g. because the test demotes. We should be able to mark tests as dirty, and in that case the test infrastructure should destroy and re-setup the environment.