I think the variety 'Arp' is supposed to be the hardiest rosemary. Supposedly zones 6-10, according to High Country Gardens.
Otherwise, I've had pretty good success with overwintering rosemary in a south-facing window... I'd probably have even better success if I was a more reliable waterer
.
