They have built a nest in the pot, Pirl. We have a problem with fire ants doing that here. When it rains, the ants climb in the drain holes and make new nests for the queen and eggs. They use the drain holes as doors. The big problem is that potted plants are usually killed by the ants. They tunnel around and leave roots exposed to air.
