A lot of cactus will handle the cold - even being frozen for months at a time. There are native Prickly Pears growing all the way up into Canada. What they don't handle is a lot of moisture.
That said, your's is one that will drop dead the minute the temps hit about 35.