Answer: I wish I could identify the caterpillars but your description could match hundreds! I found a webpage with photos of the most commonly encountered caterpillars and there are 3 pages of pictures to look through: http://www.pbase.com/crocodile/caterpillars2004
I suspect those on your plants are butterfly larvae. If so, I'd just leave them alone. They will finish feeding soon and pupate.
Q&A Library Searching Tips