Yes, the birds come and go fine without them.
I really like your flower pot idea. Maybe I'll give that a try next spring. It would be fun to see what would use them. Robins tried some really odd places this spring, even using rotted out fence posts along the road.
