Here we go again. We are going to fix something that is not broken.
It did not bloom as well because the ficus is shading it too much. Careful pruning of the ficus will correct that.
If you have to remove it, water it and use the full edge of a butter knife to act like a wedge and gently pry it off.
