Yes, those unexpected stops just happen sometimes, actually my car often turns into nurseries all by itself. Sugar Mill really is a small but interesting garden and it is a quick stop, even my husband likes to walk around that one because he knows he will be back in the car before he gets tired or hot.
Living in FL you would be familiar with most if not all of the plant material but the historic aspect is interesting.