@FaheemMitha well, I finally got around to benchmarking ffmpeg rebuilds.
Results here ... in short, rebuilding ffmpeg made no difference. Rebuilding x264 sped it up ≈1%, which, I guess since x264 rebuilds in a minute or so, is technically worth it. Even for one encode.