In my somewhat limited experience, I have found that most of the time the anthers aren't even open until they get hit with more light than they would during morning rain. In these instances I will pollinate at lunch rather than the morning and have had decent success once things have dried out.
I have never tried using pollen that was nice and ready to go before it rained.