>> if I thought all that fuss was NECESSARY, I would never start the project at all
You're very sensible, or more sane, than I am. I would bet anything that you get better results per amount of effort and time spent.
For me the Rube Goldberg aspects and "playing at science" are mostly for delight rather than for necessity.
I did HAVE to discover fast-draining mixes and capillary mats, or I would still be drowning everything in sight. Other than that, the primary excuse for most of what I do is that I like to fiddle.
A few projects might cross over into actual curiosity, and hence have a valid excuse for people with more curiosity about "why" than desire for flowers and vegetables. For some psychological reason, I would rather know "why" (and improve soil) than have lots of flowers or most vegetables. I guess I like snap peas and Bok Choy as much as "why", but it's a close thing.