Overtime different plants will use up different nutrients from the soil. So you likely should add more to the soil but I don't think you need to completely toss and start over. I'm not sure where you are from but I live around farms in Ohio and that's actually why you see different things in fields each year. They rotate crops to ensure there is enough nutrients for what they're planting.
I would imagine adding some extra compost should help
