Yes, the White Walkers couldn't swim, but during the winter, water gets frozen. What prevented White Walkers from assimilating every single human being from Westeros?