Sounds like mildew to me but I've never had an issue. Is that peony in a crowded bed or somewhere it's getting hit by a sprinkler or something? I'd certainly treat it if you think it's mildew and make sure it's watered at the ground, not on the leaves. Hopefully someone else who's seen the problem will answer with a specific thing to use, sorry not to be more help.
