OK, I was aware of n-cats. I was aware of the infinity groupoid of homotopies up to homotopies up to...That is visually very vivid in my mind.
But the simplicial set version is still obscure to me.
Thanks @BalarkaSen I'll look more int this.
Obviously if we want to retain the individual shapes and slopes of the paths we can't mod by homotopy thus, you claim, we will never get a category.
Even if we mod out by reparametrization of paths, as noted, we lose information of higher derivatives. We just retain the set theoretic image of the paths.