Toni, if you trap and take them away others will just move in and take their place. I know this for a fact, I have tried and my sister has tried several times, now we have just learned to live with them.
I will never use cayenne pepper in the bird seed or around the garden.