Yeah, that way when a new version of a colony comes out, you can keep all the old games that don't feature them as contestants.

I think that would introduce a bias, but there should be zero bias with removing disqualified players. I can't think of a way of avoiding restarting the tournament when there's an edit.

@trichoplax it'd take some work but you could try to compensate the decreased amount of that bots games with more games with it

and if that fails to do the averaging correctly, you'd still have the raw data to modify

but either way I think there shouldn't even be bias to players that have been in less games, just less precision of their position.

The bias I'm concerned about is that the average scores of all the other players from the previous games would be based on an environment without that edited player. Their scores will be different in that different environment. When a new player is added, it can make some players' score go up, and others go down.