Yeah, I feel the same about upvotes vs answers.. Though for some reason I feel that half my most upvoted answers are pretty stupid. http://physics.stackexchange.com/a/22254/7433 for example.. On the other hand, most of my favorite answers have very few upvotes :/
A zero-score-accept may also just mean that the _question_ wasn't interesting enough. If you see an answered question with a boring title, you probably won't visit it...