Hi Kim, photos are always helpful.
I have had some buds turn black when they are the size of a pea. I do pinch them off, making sure that I get all the black parts and do not put them in the compost. Most of the time when this happens, it is on newer plants after a hard Spring Frost.
... since she's in zone 5, do you have any idea?