Oh well. I was falling back on my (albeit rusty) expected value calculation. Here's the thought, though granted, it might be wrong: if X is a random variable that represents the increased damage from rerolling, the average increase is the weighted average of each possible increase. In other words, if you roll a 5, then the average increase will be sigma(p * [roll-5]). So:
1/6*(1-5) + 1/6*(2-5) + 1/6*(3-5) ... + 1/6*(6-5).