Polymerous - It could be thrips or aphids. Believe me, they can do some damage to leaves, too! I need to know what is the culprit so I can treat my plants (accordingly). Don't toss any plants yet, make sure you know what is damaging them first. It isn't always rust damage .... believe me.
