02:10
In particular, every energy eigenstate should spread out in space; there is never a position eigen"state" that is also an energy eigenstate because all physical Hamiltonians have momentum operators in them.
Now, when you first receive a quantum system to consider, you get to write down its Hamiltonian operator $\hat{\mathcal H}$
you only have that; you don't really yet know its Hilbert space, only that you know that some Hilbert space exists for it, because it is a quantum system, by postulating.
This means that the potential $\hat V$ is also given to you. You don't know what E values are the eigenvalues of $\hat{\mathcal H}$
This is very important, because you dont even know if you have bound states and/or scattering states. You don't know how many of each you have. You don't know which regions of energy corresponds to which type of solutions you might get. In particular, it is not so simple that E>0 is scattering and E<0 is bound; we prefer to have this nice separation, but it might not exist, e.g. QHO. This ties into your question about $E+V_0>0$
Oh, I forgot to point out that the identity operator and so forth that I had already mentioned above, answers your "outer product" question: Notice that the whole argument only makes sense in bra-ket notation, whereas what you were trying to write down in mixed notation is very muddied and you didn't actually make clear if you are doing outer product or inner product.
Anyway, before you can have $E<0$ be bound and $E>0$ be scattering / free, you have to consider, from the $V$ that you get inside the Hamiltonian operator $\hat{\mathcal H}$, the quantity $\min V(x\to\infty)$, because it is this that splits the energy eigenvalues.
If this quantity exists as a finite value at all, then your spectrum can have a discrete part and a continous part. If, like the QHO and the infinite square well, $\min V(x\to\infty)=\infty$, then you only have bound states and no more.
If the global $\min V(x)=\min V(x\to\infty)$, then every state is free.
There can be no energy eigenstate with an energy value smaller than $\min V$. This is proved as a theorem simply by arguing from the Schrödinger equation; If you tried a solution that way, you will find that there is no way to find a normalisable solution, and on top of that, it cannot be a free solution, i.e. you cannot find the free state's normalisation for it either. It is just unphysical.
This $\min V$ is your $V_0$ in the finite square well case. This should explain why it is necessary for $E+V_0>0$
The $\min V(x\to\infty)=0$ in the finite square well case also explains why the cut-off is $E<0$ for bound states and $E>0$ for free states; and thus there is only a finite number of bound states in the finite square well.
Only when $\min V(x\to\infty)$ is a finite number, does it make sense to shift by adding a constant to the potential, to shift this to zero, and then you have the nice separation of $E<0$ v.s. $E>0$
Now, for any system whose energy spectrum has both the discrete and continous parts, then the complete basis covers both. That is $\hat{\mathbb I}=\sum_n\left|n\right>\!\left<n\right|+\int\left|k\right>\frac{\mathrm dk}{2\pi\hbar}\left<k\right|$; when we write just the left part, it is really a lie, a lie that professors cannot help, because at the point in time introducing to students, students had yet known about this second part.
This, in particular, means that if you wanted to resolve $\delta(x^\prime-x)$, then, strictly speaking, you also need the scattering states integral part too.
This is of importance because the H atom wavefunctions are of this type, infinitely many bound states, and then Coulomb wavefunction free states.
Anyway, I dont think you should be reading Griffiths. You are too weird (for wanting mathematical rigour and completeness) and impatient. I don't know how you are meant to learn anything, but maybe you can get more out of Brian Hall's Quantum Theory for Mathematicians.
@user85795 starred for wiki that it is actually a fallacy. Not many people recognise it as a fallacy