Hum, a fiddle leaf should grow at least a foot a year. Those new leaves will add to its height but only two new leaves in a year is unusual to say the least. My "mother" plant grows two feet a year and has for two decades. Small plants certainly won't grow that fast, particularly those grown from seeds (divisions will grow much faster). What size pot is your plant in and what is your watering/fertilizing like? How about light and humidity?