Answer: Some plants such as mint can become invasive and will regrow from tiny shreds of root left in the ground. To battle these plants can be very difficult and many gardeners will use an herbicide containing glyphosate for the job. Be sure to read and carefully follow all of the instructions on the label.
Once you have taken care of the weed problem, you will need to run some basic soil tests and then amend your soil based on the results and in view of what you want to grow.
Your plant selections will depend on the soil type, and equally important, on the amount of sun or shade in that location. Your Penn State cooperative county extension should be able to help you with testing the soil and amending it as indicated by the results, and suggesting what might do well in that location.
You might also want to read up on landscaping, soil preparation, plant selection, planting, and maintenance. A book I like, because it is straightforward and includes plant lists, is "Gardening for Dummies" by Michael MacCaskey, ISBN 1-56884-644-4.
Q&A Library Searching Tips