I've had this problem too. I introduced mine because my kitty wanted to dig in my large potted plant. I covered the surface of the soil with some shale I found in the yard and suddenly, mushrooms!
The spores may have come in the potting soil or drifted in through an open window or door.
The spores are everywhere but the mushrooms will only kill you if you eat them. Pull them up before the little "hats" open to keep new spores from being released into the soil. Sprinkle cinnamon on the surface of the soil. Keep pulling and sprinkling until no more show up.