The harm is that if there are limited slots, you are requiring that one of them go to a demographic you subjectively deem necessary, which means that one person (in this case a white male) doesn't get his deserved slot/chance because you don't see him as an individual person, but as the same as other white males.