I have tried leaving them in the basement in their pots but it seems like the soil get to dried out (do have a dehumidifier down there), the size of the bulb decreases and they don't bloom. So I went back to putting them in the crisper drawer of the fridge. Which means that I can't put citrus in the fridge then for most of the winter.
If I had a garage, I think I would try setting them there, in their pots. But I guess the upside to do how I do it is that the soil gets refreshed with organic matter every year.