Some yellow pollen is not good, but I do have some daylilies that have yellow pollen that work.
Celtic Butterfly has yellow pollen but I have seedlings from it.
Some of our seedlings have really hard yellow-white pollen, that pollen is definetly no good.
If it is fluffy I would guess that it is good.