@Danu Ah. See
this answer, the conserved charge becomes non-conserved and is essentially the Goldstone boson of the symmetry breaking. If the charge is unphysical, you don't get the Goldstone boson, and the d.o.f. of the broken symmetry just vanished into nowhere.