My simpleton's answer is, any plant that you keep cutting the tops off, the roots will eventually starve and it will die. I think keeping a sharp pruning shears by the door, and going out as often as possible to 'patrol' the area for new sprouts of the ivy, cutting off every single leaf you see will get you results without weed killer. Not quickly, but a lot less work than trying to dig up every root and having the whole yard a mess for months.
You definitely need to get your bulbs planted back in where they were right away, and before the weather warms up in spring, plant the rosemary back where it was, too. Keep after it, and have faith that you will win eventually.
Reason I know this is because we did eventually control the perennial morning glory in my daughter's garden in Salt Lake this way. I say 'control' rather than kill because it kept creeping in from the neighbors' but there really wasn't much we could do except keep vigilant.
