Lilium lancifolium is a good possibility. They produce small bulbils in the leaf axils that get everywhere if the climate is amenable. It looks like a dead ringer for the ones at grandmothers and they don't all bloom year to year. Best way to find out if its a lily is to dig one up.