A friend of mine gets an abundant harvest of large sweet potatoes every year in zone 5a, so I would think you could grow them in zone 4 under the right conditions. He is somewhat limited in the varieties he can grow, though, with the most success coming from Georgia Jet and Centennial. You'll want to plant them where they get the maximum amount of sun and heat and rich, but light, soil helps as well.
