Sulfuric acid in tiny quantities is a normal component in most soils. If it were me, I would just dig the area, make sure the soil is crumble to tiny bits, and fling it out over the rest of the yard. But, if you would feel better throwing the dirt out, that would be fine.
Baking soda would add sodium to the soil, much like table salt does. (Want to kill a plant? Just add table salt.) With baking soda, you could be replacing the sulfuric acid with yet another problem. A salty soil is more difficult to deal with than any acid.
