I get that in my shade beds in the front of the house. They're shaded by hickory trees only. I used to hose the plant off and rub off with fingers. I don't think it hurts the plants. It just makes them look dirty.
When all is said and done, there’s more said than done.