Brittany!
It may be of help if you get to know the name of your daylily. DND my Stella has thinner leaves, but I'm not an expert. Anyhow I had a similar thing happening with Stella the past year, pods would set but after a couple of weeks they rot.
Here is the link to the discussion on here, I don't know if it can be of any help:
The thread "Stella de Oro aborts seed pods" in
Daylilies forum