> I told her that she reminded me of Winston Churchill, and she replied "Of all the things to say!"
That means, roughly, "Of all the things for you to have said, that particular thing is surprising or shocking". However, being an infinitive, which is tenseless, the reference is not so much to the statement as something which has been said but as one that could be said.