They are. Keep a look out for aphids and mealybugs. Ants are farmers and those are their favorite crops.
If they have nested in your pot, mix up some Insecticidal Soap and water the tree with it. Make sure you get all the soil wet. Be prepared with some I.S. in a spray bottle - if there's a nest in the pot, ants will be streaming out with their luggage in hand.