I'm with Neal on this one. Most OTs are not fertile because they are created in the lab from parent lilies that are not otherwise compatible. And the fact that your seeds are from open pollinated pods reduces the possibility more.
Your seeds do indeed look like chaff. Good seeds look like this when backlit (the line in each one is the embryo):
