I learned a long time ago that cats don't belong to people, it's rather the other way around so that humans belong to cats. So it's the cats who choose where they're going to live. And for so many of them to elect to live with you, or to visit you from your neighbours, says a lot!