The pollen will more than likely be no good plus it could be contaminated with other pollen from the bees and if you are using it that day it probably will be too late to pollinate anyway (depending on what time you get home) because it will be past the blooms prime time. Of course there is the exception to the rule and some actually are ready later in the day.
You can collect it that morning if you have time even before it opens as Mona said and put it inside. It will still be good the next day in or out of the fridge. If the pollen is on a bloom that you don't plan to pollinate you can just take the whole bloom off and stick in the fridge and then use it the next day either before you go to work or you can try when you get home and see if it will set.
