I was an admin/owner of a gaming community that played Team Fortress 2. We had an all crits server, which was really good to luring in hackers. The community was getting sick of them - understandably. So, the solution that I built was a plugin. This plugin allowed the admins to target a single player and all projectile weapons (rockets, arrows, flares, etc) would target that person. The rage that created was amazing.
Our other "go to" for trolling hackers was to set up a sentry nest and point it at a wall. Then teleport the hacker right in front of the sentries. splat The smart ones would go spy and cloak. Then they found out that we modified our teleport command to light him on fire if he cloaked.
I found that trolling the hackers back meant they didn't try to come back. If we just banned them, they'd stalk the forums or rejoin with alternate accounts.