Cara, - As a self-described amateur you are getting into dangerous territory if you attempt to replace soil at this point. My recommendation is to remove all the loose excess soil on top, but leave it in its existing pot and allow the soil to dry deeper into the pot between waterings. If the gnat larvae are deprived of excess moisture they will die back slowly.
