No matter how long a lens you carry (or wide), you will invariably come across a situation in which you could have used a longer (wider) lens. Even assuming you have the money to purchase these lenses, do you really want to carry them?
I suggest that if you have them and are wondering about continuing to carry them, count up the number of keeper shots made with these lenses, that couldn't have been made without them. Good chance it isn't very many. It seems the number of times you wish you had the lens compared to the number of actual keeper images when you do is pretty small.
Since you can't do this experiment if you don't already own the longer (wider) lens, you can at least take heart from my experience that the more extreme the lens, the fewer the situations where not only is it the right lens, but actually results in an important portfolio image. For example, for months I have been carrying my 300 mm. around with me and haven't needed it. When I was out photographing landscapes I would occasionally use it but the keepers were even fewer and frankly if I didn't have it, I could function just fine.
On the other end, I use my 17-40 at 17 mm. mod. often with my Independent Machinery project and would miss it - is there any justification for going even wider to a 14 mm., not a chance. Your mileage might differ.