Hi Bob,
Next time you water, mix up some insecticidal soap and water with that. Make sure you get all the soil in the pot. For ants, contact with insecticidal soap is instant death. Be ready with a spray bottle to get all those who try to abandon ship.