I think the answer is much like the answer given when asked about putting mushrooms in the compost...it should be no problem because the compost is not going to be eaten.
I was taught never to add any part of the nightshade family of plants to compost for fear of spreading disease. I'm guessing if the compost got hot enough it would kill all pathogens but I don't bet my garden on it.
I do agree about certain plants should be considered carefully because of possible spread of disease or even weed seeds, but I don't think that tomato leaves being poisonous would prevent them from being added.