I've stopped composting eggshells.... just because they take so long to break down and I end up with little cuts from their edges when I work the compost with my hands, which always ends up happening. I also compost the coffee filters which don't break down as fast as I'd like but at least that way I know I'm getting all the coffee grounds.
Banana skins are supposed to be fabulous for roses, by the way. And as for worms, the only thing I am pretty sure they don't like is citrus, so I don't compost any of that. But it helps the garbage pail smell better, so it's a win. hahaha