Insect (including caterpillars) poop is known as frass. It's a major component to fertilizing the forest floor. Add it to your compost, or just pour it under your plants.
Jack, I had one of those Twice-Stabbed Stinkbugs a while back. I'm glad Jean identified it because I already forgot the name!
