“that you really don't fully understand why it is more complicated than that.” -Yes, this could be the case. If this is the case, I would like to have some help to understand how it fails. lets consider the answer, http://math.stackexchange.com/questions/1592854/isomorphism-of-non-symmetric-matrices/1598868#1598868
Consider the 1st iteration only. My claim is that, if $L_i$ is unchanged(arrangement of columns and rows), and everything else is changed, then every block matrix/ sub matrix can be rearranged exactly like $E_{1,i}$. Is this clam correct or incorrect?