I don't know anything about hdris, but maybe there are different types of lights, or ways to encode light that wouldn't necessarily increase the complexity at higher reflection resolutions.

like a point light but for your hdri