I tried them years ago and only had one year where they were any good. That was when we still lived in Utah, (very dry climate) and I think since then it's been a case of overwatering them while they were growing. Here in FL when it rains, it pours and so if I had them getting sparingly watered, and there was a rain storm . . . poof, too much water.
They do smell so lovely, but frankly even growing them, the flowers don't last much longer than cut flowers so I gave up on them. They're the one thing I will buy at the store if I see them for sale as cut flowers.
If I were to try them again, I think I would keep them somewhere under an overhang so that I could control exactly how much water they get. Give them a good watering when you first plant the bulbs, then let them dry out between watering after that.