but there is a difference between fantasy and magic kind of non-realism, like a dragon shaped tower, like having your castle on the top of a mountain, etc. Sure, those things would be impossible, but are now explained with magic... fine.
What bothered me about Winterfell was the side of realism that required explaining why people built it that way. Explaining impossible towers and structures with magic, fine. Explaining dumb decisions with magic, not so much.