You have many options. I would consider the low growing, prostrate junipers for sunny areas. Other options include low growing ornamental grasses or trailing lantana (it comes in purple or white blooming types).
When you plant the groundcovers either plant them through a weed block fabric or after planting lay newspapers 6 sheets thick and overlapping to form a solid cover (wet it as you lay it to make it stick down). Then cover the newspaper with leaves or some other type of mulch. This will keep weeds down for the season while the groundcover gets established.
Q&A Library Searching Tips