Sometimes I run out of time, and don't get to cut my Peonies down until Winter. I wouldn't recommend leaving them, unless you are overwhelmed like I am.
Right now you can get bargains on garden ornaments! Cut those peonies down and stick a garden ornament in there for winter interest. 😊