@Willeke If I remember correctly, most UK citizens living in the EU are pensioners. Hence bringing them back would actually return a lot of money into the economy.
However it's much more likely for the UK to lock the status quo, rather than demand everyone to return.
As for border guard, they were outside the Schengen area anyway. Nothing would change.