I think that would be a good idea. I started some from seed last year and set them out in the garden, but they didn't survive the winter. That gives me the impression they're more susceptible to cold damage while young. We had more snow than we have for several years this past winter, but it was on and off.
