I can see three problems:
It looks like it needs some fertilizer. Are you using Citrus Food? Citrus are heavy feeders and need fertilizing several times each year.
The branches at the base with the 3-part leaves are from the root stock. Allowing those to grow will eventually kill the grafted tree.
It looks like you have the beginnings of something. Is this tree is the shade? Could be mildew.