I have been growing Azaleas and Rhodendrons for over 30 years. They are sometimes kinda like Daphne - they sometimes up and die for no apparent reason. In the case of Azalea & Rhodys it is usually slower than Daphne and is very disconcerting.
It may have just been the plants time. Sad, I know.