The two big problems I see are:
1. CPU load that the user doesn't expect (or possibly even need), and
2. There's no good way to deal with generation parameters, as you really don't want to prompt the user for them, as that defeats the purpose of the invisible background generation