I know someone who does something similar, although he stacks all of his containers into one large insulated box for the winter, with leaves and peat moss packed in around them. He has been doing this for several years with good success and we're in zone 3.
I constructed a box in my garden shed this year and have packed my containers inside - I'm hoping it works.
I'm assuming you have a cover on the boxes?
Dora