I agree, its not pretty but probably not deadly either.
While you're cleaning up the plants, I would tend to not remove any leaves that are still mostly green. They are still nourishing your plants. The mature spores that are going to fly around are more likely on the dead or dying leaves.
