They definitely still need their heat lamp. Chicks at that age will spend most of their time under their warm mother. They self regulate by moving in and out of the heat. Once they're feathered out they should be good. And when they are adults they can handle very cold temperatures.
