Hmm, it may or may not be the same thing on both plants but on the tree, I'd look on the undersides of the leaves for Sri Lanka weevils. They are white or very light grey bugs about 1/4in. long sometimes with spots. When you disturb them they can fly but not very well.
If you can put a dark colored tarp or even a black garbage bag down on the ground under the tree and shake a branch above it, they will fall onto the bag/tarp.
If that's what you find, they are extremely resistant to most kinds of insecticides and the best defense is to disrupt their life cycle by simply shaking them off the tree onto the ground and stomping on them. Or, I entertained myself one summer by going outside at night with a flashlight, and picking them off the plants by hand. I'd find 20 or so each night, and it only took me a few weeks to pretty much eliminate them.
They mate on the plant that they are feeding on, then drop to the ground, and lay their eggs in the soil, so if you can catch them either on the plant or on the ground before they disappear that's the way to deal with them.
Found a picture of one for you:
