I'm not sure how many ants you can fit into a flowerpot, but it's a lot. They all came out to see why their home was being moved. You're lucky none of them nipped you. I disturbed a nest while I was weeding a flowerbed a few days ago, and got a nasty pinch from one of the ants. Unfortunately, it died for its bravery. I mistook the pain for a deerfly bite and swatted it.