The deer never bothered my Rose of Sharon either but that could mean two things:
1. They are browsers, not grazers so after every deer in the herd took a bite, there was still shrub left (mine were shrubs)
or
2. There was enough other better tasting stuff to eat (such as my Persimmon tree).
P.S.
