Those bugs do seem to know how to hide. It sounds a lot like flea beetles. They will cause damage like you are describing and they are attracted to plants in the Solanum family = potato, tomato and eggplant.
Does it looks something like this?
http://whatseatingmygarden.blo...
** If you scroll down a little way passed the tomato plants, it shows flea beetles on potato leaves.
