I have to say I'm on both teams. Gloves are a necessity working with brambles and Pampas grass. I like soft leather roping gloves the best because they are like a second skin but are strong enough to stand up to the tough jobs. But when planting or potting the gloves come off so I can get a feel for the planting medium.
Oh, I found a neat trick to get the dirt out from under my fingernails. Before dashing in to wash with soap and a brush I shoot a jet of water from the garden hose under each nail and the dirt disappears...back into the garden where it belongs.