They do add up! A long time nurserywoman friend came over a few weeks ago and took this pic of me and some of my stuff. Mostly alpine and rare perennials for my region in 2-5 inch pots that you see here. 150 Lilium pots elsewhere, and some of those, I am not sure there is anything growing in them!
Weeds can be a blessing.... you heard me right. Especially in pots, they provide a lot of shade that keep the soil in pots much cooler than they would otherwise be in the sun. Even in colder regions with cooler summers, it's a benefit. Even Lorn knew this, and even in the garden (not just pots) if you don't mulch.
Get to know the weeds you have. You might want to manage them, rather than attempt obliteration. Allowing certain more easily manage weeds might be a good way to keep the difficult ones from getting a foothold. I specifically grow a few species of Eurasian impatiens that seed everywhere. They keep other weeds out so I don't need to weed until mid June. Then everything gets pulled out, nearly all the impatiens, too. Most of my weeding is done for the year.