While I also have no doubts that our tropical house plants will almost always show improvement if taken outside during weather they like, a lot of things can happen to a plant outside. The adjustment 2x per year can cause some plants (seemingly possibly unnecessary) stresses. "If it ain't broke, don't fix it" has always been good advice to consider. I wouldn't recommend, or not recommend, just offer anecdotes for consideration for your own decision.
sunburn
eaten by animals (rodents, caterpillars, grasshoppers)
torn up by animals
torn up by storm/hail/wind
stolen
baked too dry
drowned by rain too often
Plants outside should be secure, by either hanging, or by putting a few rocks or bricks around the pot so it's still there after a storm. Under some kind of cover is usually best too, though I do move porch plants out into the rain if the timing is good (not expecting the sun to come back out before it gets dark) and it doesn't look like a strong storm. I love plants under trees, but debris can fall on them, and those are the first to be investigated by squirrels.
AFAIK, I've never brought a plant pest inside, just soil-dwellers.