At whatever level of skill we have, it seems human nature to think that if only we were a bit better, we'd be able to relax and not worry so much about the quality of our images.
I have bad news for us - it ain't necessarily so!
From my own experience, the better I get, the higher my expectations I have for the work produced. I don't worry so much any more about finding something good to photograph but now when I do, I expect more from the image.
Look at it this way. Having produced pepper # 30, or some of his incredible nudes, do you really think Edward Weston didn't feel pressure to do more than capture a simple landscape, no matter how well done?
Unfortunately, I think the pressures will continue, even if they change somewhat over time. This pressure can be distracting from the process of seeing and I think can be detrimental to our work.
There is, however; a flip side to this pressure - it gets us trying harder, it motivates us to go back out and try again, to be more careful with our compositions and camera positioning, with our observation of all the details that frustrated us with the last image we made. It's this pressure which drives us to improve.
I rather think the one comes with the other, like in so many aspect of life, if we want the good, we have to take the bad with it.