Another option would be to clean it all out. Then you could grow your herbs in pots and just set the pots inside the brick wall. This would probably require more frequent watering but you would be able to reposition your herbs if some get taller and bushier than others.
