A weed is simply a glower with a bad reputation. Especially if it produces flowers or looks interesting.
I bought a garden journal years ago. It has lots of good tips. A calendar of tasks by month and week, and space for you to put notes. I finally started using it this spring, and still play "did I plant this? " I figure if I identify one or two a year, I'll eventually be able to tell them all apart. Until then, pretty weeds get to live, especially if I can pass them off as exotic plants.