If these were planted in the ground I would not be concerned in the least, I see ants on/around/digging near my outdoor sunflowers all the time and they do no harm. But being as these are in containers I'm not 100% certain, as container gardening in not something I do much of.
