I think they may be young millipedes. They have legs along their whole length, and fairly short antennae from the look of it? I don't think spraying the surface will help much (what did you spray with?). You could repot the plant with new potting mix (outdoors so the critters can escape). Or if it's reasonably warm where you are during the day, set the plant outside in the shade during part of the day (unless it was in the sun at Home Depot) and see if they leave.