If you pick them now, they'll basically taste like a green bell pepper. If you have enough time to leave them to ripen, they'll blush orange at first and then deepen to red. They are the most flavorful and sweetest when ripe. If you can even get them to the blushing stage, they'll usually continue to redden up after picking and taste much better than when green.
I hope the frost holds off for you!
