Oh yes, I've disturbed them or had to move them before bloom. With a good root ball with soil attached, they didn't suffer much, but were floppy that season. The next year they were fine. There have been times I couldn't get the root ball, or had to separate them, and those went dormant prematurely, and didn't bloom the next year. After that they did recover and were fine.
