I am in your zone too Polly and I have only had them bloom a couple of times. I noticed they bloom when we have an extremely warm summer.
I would not have even noticed this one bloom if it was not at my front door and because it had a slight lemon fragrance.
