Caffeine inhibits mTOR (the anabolic switch). I workout in the morning & have stopped coffee on workout mornings. I have noticed an increase in growth and a decrease in recuperation time.
On the other hand:
It increases strength, endurance and fat burning - ideal for cardio days.
It even has anti-oxidant properties and decreases your risk for pancreatic cancer.