It's hard to tell because they are so small, but I think I see some little white specks on the stem and the bud, even on the leaf on the left - they could be aphids or thrips. Do you have a magnifying glass that you might look through and see if you see any little creatures in there?
Aphids
http://www.daylilies.org/ahs_d...
Thrip - although I think this is really high magnification.
http://www.daylilies.org/ahs_d...
Also might see if you notice any tarnished plant bugs on your scapes or flowers
http://www.daylilies.org/ahs_d...
