That maybe botrytis blight. "Small buds that are affected turn black and wither.", according to the Missouri Botanical Garden. The affected parts should be cut out and discarded in trash immediately. I don't know if fungicide helps now but just to be safe, I would spray the whole plant with fungicide. I am sorry that your peonies get this but your quick observation of it and removal of the diseased parts will help alot.
