You can definitely remove lower leaves as many lower leaves as you want without harm to the plant. However, that will not lead to branching anywhere else. This is a plant that does not branch readily. Sometimes, if you prune off the top growth, that will encourage two stems to grow in at that point, but not always. It is a crap shoot. If you are trying to develop a branching tree-like form that you see elsewhere, it is not going to happen with yours.
Otherwise, your FLF looks healthy and well cared for!