I've not heard that red wigglers are displacing native worms, so I can't speak to that at all.
A think a kitty litter bin would be small but it would definitely work for a while. Eventually you'll want to step up to a larger container but it's easy to move the worms at that time.