With some plants I think it's a matter of it maturing enough to produce a quantity of blooms that makes a fragrant impact. The first time my night blooming Jasmine bloomed I didn't catch a whiff of scent, but the next year it was double the size and full of blooms and I could smell it from the upstairs bedroom window.
