Good drainage is essential for Rosemary. I'm wondering if your compost-blend mulch is too heavy and holding in too much water. Think about where rosemary grows wild--rocky, sandy, sunny locations in the Mediterranean. Might also be getting too much fertilization from the compost. In general, it really does not need any additional fertilizer. Your idea of adding some rocky drainage may be a good solution.