Without resting, you won't have enough energy to properly break down your muscle tissue so that it can build back up. If your goal is to build muscle, then to get the best results, you need to break down that tissue.
If you're tired from doing other exercises, you won't achieve the most repetitions in your sets.