@IuliusCurt Yes, because training-set accuracy is at 100%, the model is probably underdetermined (and hence non-identifiable), which suggests you either need more training data or a simpler model.

Someone asked me today whether it was correct to say their test was significant, since the p-value was below 1.

I suppose at a certain level of significance, that is actually true.