I've done well with sweet potatoes as a novice grower of those, but somewhat experienced general gardener. Actually, our weather in 2016 this area was fantastic and I got huge ones. I'd encourage you to try again. Are they in full sun? Bugs on leaves, or in the tubers?