Ben, you need to spray the Roundup on the leaves, not on the stumps. The plants absorb the stuff through the leaves.
Still with bananas, as Hetty said you need to dig the whole clump to really be rid of them for good. You can chip away at it, a hunk at a time but you're going to find there's a huge root mass under there, I fear.