with Sherry, it does look like leaf-spot. I leave it alone too unless I find a specific cultivar to be a leaf-spot magnet and then I remove the plant to reduce the contamination of the irises around it.
Of course I talk to myself; sometimes I need expert advice!