Just by knowing you, I know for sure that you're a pretty eased person. However, I've noticed that little things tend to bother you. Nothing at hand that I can think of but I'm sure you know of some. If you eliminate those, you might see some progress. Also,
adrenaline synthesis has the tendency to diminish if you're consistently under SHORT TERM stress. Things such as lifting, freaking out about calories, lack of sleep, studying for an upcoming test, and the list goes on... could be contributory.
Another thing, lifting has a big impact on sympathetic nervous system activation, so what you're describing could also signify that you're at the precipice of draining.
Just my 2c bro.