You may be right. I wasn't thinking about the thrips growing up and flying away and sucking all the life out of the leaves. As Alyssa hasn't really noticed any damage to her plant, springtail may be it.
Insecticidal soap is still what I would use.
Alyssa, what kind of plant is it? Maybe you could water it less and make your plant less desirable to creepy crawlies.
Do dead scorpions sting? My grandmother had a big black one that lived on the wall in her bedroom. It kept us kids at bay - no way were we going into a room with a know scorpion in residence.
Daisy