, once a woody entity has entered a mode of forming side branches, it can be difficult to stop. Imagine trying to cultivate an oak tree to have just 1 branch. It's a sign that your tree is progressing past baby/toddler-hood.
Maybe you and your husband can find an appreciation for that aspect, a fine accomplishment, and lovely tribute to the strength of the good vibes in your home. A blessing, a gift from your very happy plant, more of itself, and more stems of lovely, vigorous new leaves to grace your environment.
... but if you or he think that's a bunch of hooey, rubbing them off with your thumb while they are so small could make them stop, or it might not. Best luck & enjoyment! :+)