Right, once you cut a stem or fan out, it won't come back.
You probably won't have to trim it at all this year. It's a pretty foliage plant right now, and it looks like there's only one fan. IF you have room in the house, keep it going through the winter. They stay green here year 'round, so they don't need a dormant period.
