I recently made two raised garden beds and filled them with dirt that was moved from our back yard. I plan to direct compost in them before planting but there are a lot of rocks throughout the soil, but I plan to rake off the top layer of rocks. Will the rocks that are deeper in the soil be a problem?