I used to do a thorough fall clean up, until one fall,--- I opened a Lavatera seed pod and found a lady bug curled up inside. Now I just clean beds for bulbs, and leave the rest for the wintering critters. This fall I am going to attack a massive pruning job to lessen the shade in my yard. So I probably won't get much garden clean up done this fall.

We have lots of voles and any remaining debris in the gardens encourages them to hang around for the winter.

Good luck with your prunung project.
Sounds like lots of work but worth the effort!