Did a thorough application of Neem oil last night!! Made sure it was under and over all the leaves, etc. I came outside this morning and found a ton of these guys again in the soil crawling around all over. What's interesting is I only see them in the soil and not on the plants themselves. Though something is definitely making holes in the leaves. So I wonder if I have two separate problems. Didn't find anything under any of the leaves, though.
I also have only seen these little guys in the soil of 2 of the 4 gardens but the leaf issue is present in all 4 raised gardens.