You are taking them in during winter, right, Chelle? Of course you are. I think they'll be fine. They're really hard to hurt, neglect often just makes them stronger and surprises you. About the only thing that really hurts them is too much water but if your soil drains well then that's really no problem either.
I hate stakes too, but I keep a few of those green coated wire things with a circle at the top and stake them when I remember to. Mostly I have bushes now, simply because I hate staking so much. At any rate, my thoughts are that they will be just fine even with our benign neglect.
It was your manure based compost/straw this year that gave them all they needed.
I don't know, you are talking to the one who totally neglected hers last Summer and Fall and wasn't able to do any digging to bring them in last year either. There were about 5 or 6 that bloomed in mid August until just about 3 weeks ago. I could barely see them for the weeds and then my patch of goldenrod got loose in front of them so it wasn't a very pretty picture. It's been a rough year for plants around here.
For people too.
It's just a really good thing that most of our plants are much stronger than we are.