@Gallifreyan Then it seems to me that being a member of the ruling class is not requisite. For one thing, you can't have a ruling class for a dead society, and for another, my impression is that the
High/Supreme Council of Time Lords was the governing class, which implies that the time lords themselves are a bigger group than just the rulers.