Congratulations on flowering your Croton indoors.
I grow many Crotons out in my Florida garden. I have never removed any of the flower stem.
You are witnessing a male flower stem, with no chance of it producing seed. You may witness a female flower stem in the future, but are much rarer than male flower stems.
Male flower stem...
Female flower stem...
