Answer: Based on your description I would suspect it is a fungal infection such as botrytis. Here is a picture of that:
You might want to contact your county extension for help in verifying that diagnosis and a recommendation of an appropriate fungicide. In the meantime, pick off and remove any infected blooms to reduce the chance of reinfection; also avoid overhead watering, especially at night.
Q&A Library Searching Tips