The warm soil, the connection with the roots of a plant (tenderly seperating them when I have to split them is easier with hands), and weeding are all better for using bare hands!
For the big stuff - wait, there Is No Big Stuff in a small garden......... so I never wear gloves unless I have to, and then it's not gardening.