In your zone you probably can. The big deal is that you can't expect them to adapt to a large sudden temperature change. I would try not to give them more than a 20-25 degree F change all at once, and that change should not include freezing. You could put them in the fridge for 2 weeks as an interim if it is too cold outside in a month or so.
