I have most of my daylilies in south and southwest facing beds behind my home, and they grow and bloom well. I have a few near my brick walls, but I plant them at least 18-24" away from the wall for circulation and maintenance. Here in zone 6b, I have cannas planted against the brick and foundation (south wall) and do not have to dig and overwinter them. Your only problem may be watering in a dry spell or in case of a large overhang as mentioned by Robin.
