I cut mine down just as soon as I can't stand it anymore.
It always comes back each year thicker and more beautiful than the year before. I'd had misgivings at first, too, due to the hollow stems, but it doesn't seem to bother them at all. I, too, think that keeping the mildew from attacking spent plants by removing the stalk is more beneficial than anything else.