When you move the soil..... move it! if it is not baked or saturated in an anti fungal it should not go back into your garden. When I have soil that is unusable, due to natural issues but ones I do not want in my garden, I get completely rid of that soil. That may be overkill but I don't like to worry.
