+1 I'm sympathetic with OP and lived a similar situation and yes, some people are j@rks and just want to get under your skin, for those I say
"I'm proud to be from x" what in general put this kind of people off guard. A line I got from a movie I often use is
"From many places" and start diverging speaking from many places I lived. —
jean 1 min ago