I would be afraid that to much cold (below 45) might stunt them. I know that last year, some annuals and vegetables that I moved out to my screened porch to early, were not at all happy about it, and while they survived, it put them about a month behind, and some never grew to full potential.
