Mine do the same thing Jelinda. I've had mine in the ground several years and sometimes they will still have some sprouts. Even after the snow and hard freezes, I still have a few that are still untouched because of the dead leaves protecting them. Some people cut the dead leaves for aesthetic purposes. Others say the dead leaves can harbor disease. Then I've read leaving the dead stalks on provides starch for the plant. I usually remove all of the leaves in Spring when I see little sprouts. I leave mine alone even if I see sprouts in Winter. Hopefully someone else can give much better advice.