90% chance you have some sort of root problem. Either your soil gets waterlogged easily or you need to dig up those peonies and get a closer look at the roots.
I've seen (mercifully not in my garden) very similar issues caused by root nematodes on herbaceous peonies and I hope it's not what you have.
