They do grow here in our zone 8. But won't get to be the size they are capable of becoming as a mature tree. I grew up in Southern California, where you use to see really large fig trees.
I can still smell the scent of the leaves and bark by just thinking of that tree.