Overall, I definitely prefer NO GLOVES.
But, the risks you take working with metal, sharp edges, plants that poke and prick and slice, disease, and the risk of running into a scorpion barehanded tell me to wear gloves.
I'm not much of a planner. When I go to the garden it's possibly to move the dripping hose to another plant or pick some new growth off the Tarragon. In reality I know full well that little trip could end up to be 2 hrs clipping bushes and cleaning leaves without my gloves...because I didn't "plan" to be out doing maintenance.
If I plan to trim the bushes and clean out the fallen leaves I will put on the gloves.
I use the gloves sold in auto-mechanic stores (or Home Depot) with the Velcro wrist fastener. These are the only gloves I wear because they give the most tactile advantage.
