Aw, Cheryl -- we all have to give up on certain things, that's only sensible! Giving up on gardening? Never!!
I think the secret to have a really fabulous-looking garden would be to grow only the plants that are easy to grow and do the absolute best in your climate; but, where's the challenge in that? I love trying to grow new things and things that really shouldn't be grown here (and then there are some things that I think are going to be no-brainers and give me the most trouble...). So, I don't expect perfection (and believe me, I don't get it, either
)