Hi Winnie110520! You can move them in the spring but you'll want to be very careful with them, try to disrupt the roots as little as possible. I actually moved a few tree peonies yesterday and I'm in a very warm zone. I don't take moving peonies in spring lightly, if roots are injured it will certainly cause the plant stress, but needs must at times.
My advice would be to find a new spot that they can live in for the foreseeable future and dig your new hole. Dig the root up, keeping soil in place as much as possible around it and get it moved immediately. Try not to expose the root, you're trying to save the little skinny feeder roots that pull in moisture and nutrients for the storage root, so as little jostling as possible. Water them in well at their new location and keep an eye on them as the weather turns hotter. If you see them wilting more than normal with regular amounts of water place a shade source on the afternoon sun side of the plant, it'll keep the plant cooler and lessen demands on the roots as it's getting reestablished. If done carefully with a smaller plant a lot of the time you see no issues with this kind of move at all, gets harder to get the root out in one piece for larger roots. Just concentrate on doing as little root damage as you can! Good luck, let us know how it works out!