We recognized the same problems here in Michigan, Joshua.
We found the acreage we wanted - a 90 minute drive from the city. We accepted the fact we'd drive quite a ways to buy basics, that we'd live on a dirt road, have to dig a well, build a house, barn, shed, etc., but have never regretted being in the country, wide open spaces, peace & quiet, farm community.
Back then prices ran $1,800(USD)/acre. Now an acre is running around $2,700. The soil tilth and drainage were factors we considered, too.
When we look back on what we did over the years we say we're glad we did it because in today's world we could not.