I think your memory is correct (e.g.
arxiv.org/pdf/1502.01640.pdf). I think not much is known about these things, and I think some folks think the answer for automorphisms is
not Top(n), for example. It's also worth pointing out that if you start completing these operads, or looking rationally, you get all sorts of interesting things...