@AdrianLarson Hey so... I wanted to see how simple it was to setup and I was able to do it pretty quickly, check it out: salesforce-community-slack.herokuapp.com
In slack you can either "Add a reaction" (which just adds emoticon to it w/o disruptive notification), you can also share it with your response and it will keep it on topic, or now you can even start a thread from that comment and have a complete side bar while still in the channel and only notify the channel when necessary