I have deer and they never seem to bother either my ginger, plumeria, or garlic. I guess they don't like much of anything I grow. There are hundreds of potted plants at ground level for them to munch on and I don't think I have ever seen any damage to anything. Now if you want to attract deer, plant sweet potatoes and melons. They can't resist those leaves.
Ginger would be a perennial for you, dying back in the fall and returning each spring. Like me, you would have to bring plumeria inside in the fall.
