I go vertical indoors, depending on size of plant and weight of container:
This is my orchid stand, just a fence post from our local Home depot and my hubby just made it with wheels so I can move it easily to the sink; but usually I just remove them one at a time.
I use hang-a-pot hangers and containers with a lip so it can easily latch on it:
