(there is actually a line of thought that takes this idea and runs with it far into category land, namely that the "correct" objects of study should not be manifolds but
generalized smooth spaces, which include far weirder objects than manifolds but are built on this idea "a space is something that can be mapped by coordinates")