Abhinav, let us first look at what is grav. potential ? It is the potential energy associated with a unit mass to bring it from infinite separation to the given point. So, as we know that in classical physics, grav. force is always attractive, therefore it is the grav. field that is doing the work, not we as an external agent. As field field is doing the work, therefore it increasing the kinetic energy of that mass.