I wouldn't go quite that far. It is poisonous to sheep and goats, but not a particularly dangerous plant to humans, as long as they don't eat said livestock. Cotyledon orbiculata is not unique in the genus or even the family in this regard. I can think of other plants that I would be much more careful with than this one.