I don't see any ants in your photo, it looks like some other type of insect pest to me. Possibly aphids or scale? See if you can properly identify them.
I'd start by just washing or gently rubbing off as many as possible. Once you ID them, there may be more specific treatment.
Big aloes are my favorites, I can't grow them here but make a pilgrimage to Desert Botanical Gardens in Phoenix when I can, they have a nice collection.