I go around and try to cover in mole holes and disturb the runs, but then I'm looking at winter freeze, and you are probably not. (I think they hibernate here in winter.)
One of the reasons you spoke of is why I really dislike moles. I plant some nice new things (small) annuals and perennials, and they will come and make their run under the row, or a part of the row, lifting the plants out of the ground, and if I don't catch it, and it gets very dry, the plants die from lack of water ... not that they hurt the plants in any other way.