I have both red wigglers and nightcrawlers in my compost piles. My piles heat up for a good while. During that time, the nightcrawlers go deep (usually do anyway) and the red wigglers migrate to the margins where it's cooler. When the heat subsides, the red wigglers occupy the first for our so while the nightcrawlers are usually deeper but make trips at our near the surface.
Worms don't have teeth and have small mouths. It's important to remember that. They require things to break down into extremely small particles, gel, and/or liquid. So large particles aren't eaten until they can actually be broken down by bacteria and fungi. That said, while I do put eggshells in my compost, the fact that they're mineral and large particles means I either have to powder them for them to be immediately usable or something else needs to make use of the shells first in order for them to be available to worms. I'm able to powder (actually more of a male texture after processing with my ninja) about 2/3 of my shells. The rest I do a quick crush with my rake but as them in larger pieces. My opossums and raccoons feed on larger eggshells anyway. Over time, large shells will process, but it takes years. I don't have any problem with considering large particles part of my long-term soil development.
Coffee grounds are fantastic both for worms and for black soldier fly larvae (BSFL). BSFL can process larger organic material with no problems. Some say BSFL make compost uninhabitable for worms. I can tell you that isn't true in compost piles They do process a lot of big stuff into small stuff and they do it quickly. In doing so, they create a really most environment around them. When they're in large numbers, the worms migrate to their edges. But eventually, they're back in all areas. BSFL do cause problems in worm bins that have limited area making it difficult for worms to migrate away from the high moisture caused by BSFL. I don't have that problem in compost piles. Anyway, IMHO you can't have enough coffee grounds (taking care to make sure the "browns" are available in correct proportions to allow for some hot composting. I use a LOT of coffee when I can source it (I don't drink it). My recent source fizzled out and I'm searching for one or more others.
I also get spent brewery grain, SCOBY and yes leavings from a local kombucha manufacturer, massive amounts of leaves (my browns), and eggshells from a local bakery. In fact, my eggshell pickup is today! I'm constantly looking for more safe inputs.
As you increase organic matter those worms will find you. Once you get them you'll need to assure a regular supply of organic material or most will move on once there is nothing left for them to eat.