I think pot size should be determined by the size of the root structure. I wouldn't want to put a plant with few roots into a real large pot but I also wouldn't want to have a plant with a lot of roots so cramped in a tiny pot that there's no where for the roots to go. I've had some hoya plants grow so quickly that I've had to up pot them every year.
As to being disturbed; I've moved hoya plants from one place to another quite often without any issues ... except for a couple of times when I left them in extremely hot, blazing sun and they fried! They do like bright light and can take some sun ... and some varieties may take lots of sun as long as they receive sufficient moisture.
I sure miss
@AlohaHoya/Carol and her great advice on growing Hoyas.