I'm hoping to identify an SF story (read it at least 20 years ago, I think), where Earth has set up a base on a distant world, and when the locals see how advanced they are, they quietly give up on themselves, and stop having children. The governor (or similar) from earth has conversations with ...