@user21820: I agree with you that this word shouldn't be used for that very reason, but I think in this context Oliver should be given the benefit of the doubt. In the
Oxford Dictionary, it is listed as an informal (but not derogatory) word for "man" in British English. In American English, it is derogatory and informal term for "old man".