Cacti need very little fertilizer, and all the sun they can get. it's not happy being moved in an out. Where cactus live in the deserts, they get blazing sun during the day and very cold nights. If it has good drainage, and you're not freezing at night, it would be happier left out...maybe some overhead protection if you are getting a lot of rain.
