In my experience ants go into my succulent pots for two reasons. One is for the moisture (we live in a dry climate where there is no rain for half the year) and the other is to farm insects like root mealy bugs which are sucking nutrients from my plants and secreting honeydew, as a reward for the ants tending them. I tend not to worry too much about the former, but the latter may actually represent a health problem for the plant (the sucking bugs, not the ants). In either case they live elsewhere but come and visit the plants for food or water. Now our ants are probably different from your ants, but this is just my experience. If I try to eliminate the sucking bugs (using soapy water or a systemic insecticide like imidacloprid) the ants tend to go away, but they will also try to restart the infestation by bringing in more bugs from elsewhere. So controlling ant traffic is necessary in the aftermath of any attempt at controlling the other bugs.