That's fine. It's just that targeted voting accusations are rarely accurate; users can't tell who's actually downvoting them. But we have a tendency to see patterns when they aren't there - I think it's similar to
apophenia, if I'm using the term correctly.