I trim them up in spring before bloom time. You could trim them now, but would be likely to need to do it again later if you get more really cold weather. As I do my winter garden walks I pull off dead leaves that pull away easily, but will leave those that are still attached- many of those will die off in the next few weeks and I'll be able to gently pull them off as well.
