I also have one of those oil-filled heaters in our new addition. There is an in-wall heater, but the oil--filled one (and on the lowest setting, too) does a much better job! As you say, almost TOO good.
I'll have to look around for the rolls of solar blanketing. There is one section that could use a bit more insulation.