Matrices as elements in a vector space seemed to have some kind of ordered structure since
$$\begin{pmatrix}a & b \\ c & d\end{pmatrix}\neq\begin{pmatrix}c & d \\ a & b\end{pmatrix}\neq \begin{pmatrix}b & a \\ d & c\end{pmatrix}$$
If we don't think of matrices as made of column vectors, then how mathematically is this order structure is being introduced?