I have not seen this shrub in my zone 5 , but I have grown lemon verbena in my herb garden . It is an annual here and I don't remember it ever flowering for me. I grow the lemon verbena for the scented leaves.
Do the leaves of the almond also have a sent?