Have you done any soil testing? How about water drainage testing (percolation?) Here in Ohio, on my property, I have clay, and the water will not drain. Period. If I do not add tons of amendments, and raise the beds, plants do poorly or die.
You mention that the soil is red and not gray? Does ths mean that you are in one of the southern states?
I would suggest that you might try contacting your county extension office for a list of how to reach the master gardeners in your area. They will be most familiar with the soils in your county and the best ways to improve them.
For improving the soil to grow only daylilies, you might talk to your nearest daylily society and see if any members live near you to ask.
Reason I'm recommending this is what works here in Ohio, with our soil may be the wrong thing to add in, say, Georgia.