Do you need to lift them because you need the space for something else, like summer annuals? Normally those bulbs would be left in the ground year round. If you have to lift them then ideally they should be left in the ground until the foliage has died back or at least started to.