At my house... deer and voles love to eat echinacea.... deer eat the foliage, voles eat those fat roots...
But... echinacea grows easily from autumn planted seeds... or even late winter planted seeds... apparently it doesn't take that much cold to help break dormancy...
So... maybe the deer won't want them at your house.
Try growing cleome... deer don't seem to have any use for it, and the butterflies and night flying moths like it.
@Treesamia Where are you gardening? Knowing the general area will help us with suggestions.