Maybe some insect or bird is eating the buds before they can open?
When it forms the green clusters, maybe pick one and see if there's any bug activity on there? A hose-end sprayer and a spray of mild soapy water solution might take care of it if that's the problem.