It is good practice to remove the leaves even if it is a big chore. You don't want a mat of leaves in your storage area with the result that you get bugs etc breeding in them.
The seedpod should happily hang on through dormancy and will further mature, to open some time in the late spring.
