Lynda, feral hogs or "wild pigs" do a lot of damage here too. They tear up the ground.
Evelyn, perhaps Frank has dogs? My experience with deer was when I started putting daylilies in the unfenced garden along with the irises. I came out one morning to find all the daylily buds neatly nipped off their scapes! The deer don't bother the irises at our house, however - not at all.