Pouring a bit of a foundation with concrete is the way to go, in my opinion. Gordon is right: dig down with a posthole digger and mix up some quikrete. You can make it so that the entire foundation is below grade, and then put your stepping stones on top of the foundation. But this will be much more secure than setting the stones on the ground (where it can sink).
