Answer: I think the insect you're describing is a cave cricket, sometimes called Jerusalem cricket, or potato bug. They live in moist habitats such as underground, under logs, in tree hollows, or in burrows created by other animals.
Jerusalem crickets are common from California to Washington, and some are found in the mid-Atlantic states. They feed on other insects, plant roots, decaying vegetation, and potato tubers.
There are no chemical controls that I can find, so you may want to just hand pick and toss them. The female usually devours her mate, so you may have fewer pests to dig if you wait until late spring, after the mating season.
Q&A Library Searching Tips