The best time to divide a peony is in September through early November. If you just want a chunk off it to give to someone you wouldn't necessarily have to dig the entire peony, just put a spade down through the area you want to divide off and dig that piece out. Again, this is best done in September through early November.