That's pretty much my plan.
We left the stump a couple of feet tall for interest and I plan to put a small fountain and a couple of potted plants on top, then make a nice flowerbed around the base. I've ordered some hardy ferns for the base of the stump and hope to get some astilbe going in that same area.