I've also experienced this problem - mulberry trees suddenly appeared out of nowhere. In one area I'm in the process of converting the space (which is anchored by an ancient Black Walnut
) into a shrub border. Mulch is my friend at this point. The understory trees and shrubs have not shaded out the unwanted scrub plants - this year, due to the record rains - we ended up with tons of poison ivy! Under the walnut we planted red buds, star magnolias, ninebark, japanese maples and a number of spreading evergreen shrubs. Hoping that repeated weeding, lots of mulch and maturing plants will smother the weeds. Good Luck on your project.