Dewberry the shrubs and plants I think of first for fragrance are tea olive, gardenias, and white butterfly ginger. The tea olive( osmanthus fragrans)blooms in the spring and fall and you normally don't see the flowers until the wind catches the scent. It makes you swivel your head thinking where did that come from?!
August Beauty gardenias, if you deadhead old blooms it will rebloom.
Hedychium coronarium/or flavescens will bloom in Aug/Sept and continue to frost. Wonderful scent. The gingers are the only ones that I have potted and they will do fine. All of these plants are sun lovers.