I've gardened on the same small lot for over 25 years. When I moved into the house there were many large trees and I had to learn to shade garden. Then due to a number of storms with high winds the trees all were damaged and ended up being removed. Some fell into the garden and destroyed the plants under them. My large hosta collection ended up being exposed to full sun in late July. Gave them to people with shade. Once rabbits got so numerous they ate all my lily buds and anything else they could. Drought one year along with water restrictions killed off a few more plants. Bag worms destroyed a few evergreens. A week ago large hail shredded the leaves of many plants. I think most gardeners have similar tales of woe to tell. Have I ever thought of stopping? No way. Now that there is very little shade, I enjoy all the full sun plants I can grow. Over the years I've learned what grows well here in Nebraska and have given up on a number of things I would like to grow. If you really love gardening you will just keep trying different plants and methods of growing them. You will most likely find that your taste in plants change over the years too. That's all part of the challenge and excitement of gardening. It keep us young, strong and growing. Please don't give up.