If you can trust your memory that flowers were not yellow, and yet, apparently, don't know what color they are - you can look here if it is a lithospermum:
http://michiganflora.net/genus...
At the bottom it differentiates your two suspect species. I can't see the underside of the leaves in your pics, but the pubescence on the up sides would be "mostly somewhat ascending".
