How cold is "cold"?
My African violets live in 55-65F all winter. They are very happy. But change one environmental factor, and chances are you will need to adapt another, too. In this case, watering. Keep them (and all houseplants that find themselves growing in cooler temps) in drier soils. Although the African violets don't grow much, the individual flowers seem to last forever!