Answer: Your garden sounds wonderful!
There are several possible explanations for the lateness. A common one is cold soil temperatures at transplant time. Many gardeners find it best to start their own pepper transplants and wait to plant them out in the garden when the soil has warmed. One good method to help warm the soil sooner is to use raised beds, another is to cover the soil with black plastic mulch beginning early in the spring. This, combined with row covers when the temperature is below 85 degrees, can help accelerate the crop. It is interesting to note that yields can be significantly decreased by simply transplanting them too early when the soil is still cool.
Other possible causes could be the varieties you are growing since some are much later than others, temperature extremes during the flowering period, or an overabundance of nitrogen in the soil (this is quite possible early in the season if you are using a compost rich in manure).
I hope you have better luck with your peppers!
Q&A Library Searching Tips