A compromise would be to leave them be for six weeks after flowering and then dig them. It's a lot easier to get them out if they still have upright leaves for "handles" though because there's less bending to pick them up. But I have done it before that and many still flowered the next year.
