Hi Jelinda, I had the same problem, I felt that it was keeping the plants wetter (but I'm in Seattle and its very wet right now) so I removed the leaves...and continue to do so because Seattle falling leaves seems to happen all winter
Seems that if you're going to remove them, sooner would be better, especially since you're going to use a leaf blower...just my 2 cents
Cheers