Is it OK to bring my seedlings indoors over the winter, or do they need to experience the cold, like peonies do?

I bring my small ones inside. They do great under grow lights and are ready to plant out in Spring.

If they're large enough to bloom next season, and they're dormants, they'll appreciate some winter chilling, but you'll want to protect daylilies in containers from extreme conditions.