Yes, pretty much all plants can benefit from magnesium added to the water occasionally. Most fertilizers include a tiny amount of it as a "trace element" but tropical plants (which most house plants are) use more of it than other plants because they keep on growing year 'round.
Your plants that you mention above are mostly succulents, aren't they? So just a light spray or a small amount added to the water when you do water should be enough.
In tropical environments, usually there is a rainy season (June through Sept. here) when it rains torrentially and nearly every day. Soluble nutrients like magnesium are leached away very quickly in those warm heavy rains so I regularly use added Epsom Salts on my garden in the summer (whenever I think of it).
