Well, I guess I'm very lucky because I have a large, wooded area behind my home. The layer of leaf mold is quite thick, going down several inches. It's there for the taking.
I think I remember reading that as they decay, grass cuttings create too much nitrogen for worms. I believe there's a caution about using it in the bins. So if you're putting grass cuttings into your compost pile, the worms might just go elsewhere as they're bound to do.
Is it possible that the tiny red wormeys are baby red wigglers? If they were white, I'd guess that they're pot worms (not harmful).