@Shalvenay It works, but then you have the problem that you're effectively just fighting yourself, and that takes the fun out of it for both you and the players when I've seen it happen.
I have had some success with a GMPC who is effectively just a heal bot, for religious/other reasons won't attack or be directly involved in conflict. Makes things easier for you as well :)