Answer: Yes, you can remove them from the pots and shake off the excess dirt. It is a common practice in the south to hang a plumeria plant from the rafters in the gargage or to stand it in a corner over the winter. Don't worry about them drying out. They'll be fine.
Make sure they are not exposed to cold temperatures over winter. They need to stay above about 45 degrees. Repot the plants when it's good and warm next spring.
Thanks for the question!
Q&A Library Searching Tips