What if we used something like
Redis to store the list of posts? One queue could have a list of post ids and sites, another could store API responses for each post, a third could contain posts identified as spam, and a fourth could store chat messages.