@katydid1155, if you don't mind, please update your "Profile", putting your location. City/state is most helpful along with your USDA zone.
I just don't know what's going on. Mulberry trees used to be frequently grown in the south but I seldom see one any more. I am sure it is because of the mess they make and the fact that their roots are so vigorous and dense. Perhaps as Rita surmised, it is the roots that are causing the problem. My raised garden is about 50' from the nearest oak, and every year I dig up the garden in the fall, to prepare it for planting garlic. I always encounter masses of fine, dense roots about 6" deep. I just cut them off as much as possible, then pull those root-masses out by hand, and toss them in the garbage. The garden soil, being so loose and so fertile, is a magnet for tree roots to invade and literally take over a garden's soil if not constantly battled. At least that's been my experience.