Most Daffs will hang in there, even with neglect. However there are some hybrids that will perform well in a tended garden, but aren't suited to naturalizing, and will dwindle with too much competition from grasses and weeds. I neglected my gardens horribly for a couple of years, and weeds as well as encroaching shade caused the dwindling of Ara. Once I got the area well weeded, and removed the tree that was shading the area, they have bounced back on their own.
I have another variety that is dwindling in a kept garden space. Its a yellow/pink bicolor called Billy Graham, and I believe its just a weak variety. My plan is to dig them after the foliage yellows, and before replanting I'll amend with compost and work in some bone meal.