What a pretty Croton (Codiaeum variegatum 'Petra') I have a few Crotons growing in my yard and a couple that I keep in containers and I've never pruned off the blooms. I'm curious as to why your neighbor thinks you should remove the flowers.
~ I'm an old gal who still loves playing in the dirt!
~ Playing in the dirt is my therapy ... and I'm in therapy a lot!