This plant is new, I've only had it about a month, there were no buds on it when I got it, and I have not noticed any buds laying around. I have noticed a couple buds come out and bloom, then they dry up. I just checked it, no bugs, but a couple of new buds. It's in a 6ft. planter with 3 other plants. We chose them with bees and hummingbirds in mind. The others are a blue-purple russian sage, orange trumpet vine, lucifer crocosmia. Placement was intended to ornamental, we wanted to "jazz up" the shed for more curb and personal appeal. At the time I was not checking for sun needs, just plunking them where we wanted them, and these should have more sun. They're in the shadow of the shed most of the day, but they seem to be doing ok, although the lucifer whatever seems to be slow growing.
Long story short, probably should just give it more time? Could possibly consider relocating them, planter and all, but then I would have to get another planter for that side of the shed and also plants that need less sun.