I lived in the area for a few years. You're going to have to get used to a while new way of looking at plants & gardens. See, I'm a south Floridian like you & I was completely lost when we moved to north FL. Nothing is going to bloom year round - just forget that right now. Everything is now going to be seasonal. It was really hard for me to adapt. Get anything tropical out of your mind. Just go ahead & do it now. It will save you pain later. Do not try to grow ANY tender plants - forget about it! No, well maybe they'll survive, they won't.
OK, now you think azaleas - learn how to grow them & when to prune them
No, Tally is not cold enough for tulips - don't waste your money
Tea Olive - Osmanthus fragrans. Tea Olive (Osmanthus fragrans)
Japanese red maple
You could do some Witch Hazel down by the creek/lake also sassafras
Non tropical gingers
You absolutely must go to
Allow a whole day. I'm serious! It's HUGE. More importantly, they know their stuff backwards & forward.
There's a hibiscus -- I forget the name - it has blooms the size of dinner plates & will withstand the cold. Would never grow in south FL. Ask Tally Nursery, they'll know what I'm talking about.
You'll doubtless have trouble with deer & moles. Just a warning.