Try stomping on the leaves or cutting them up some more, maybe? Most likely the aromatic or repellent substance needs to be released from the leaves to make it work. Just like crushing or cutting herbs releases the flavors and fragrance.
The fact that they aren't eating those leaves is signficant, though. Certainly something is not appealing to them about the beautyberry.