They just don't appreciate your gardening genius!
I think my favorite gardening-crazy moment was when i was doing some major excavating to put a drainage pipe BELOW a walkway that is sunken beneath and alongside a raised bed.
When I stood in the trench digging, the raised walls of the bed hid me at least waist-deep. From a distance I think they could only see my upper torso as if I were half-buried. But none of them said anything!
Back then I had more garden-friendly neighbors, including Atilla The Gardener. She mostly buys plants instead of starting from seed, and her rule is that she will give a plant that doesn't thrive right away ONE more chance. She will re-pot it or transplant it to ONE other location, but then KKKKKKK - (making throat-cutting gesture). I'm so wimpy about killing plants that I immediately named her "Atilla The Gardener".
When Atilla saw the yard of crushed stone / grit / coarse sand I bought, she went crazy, running her hands through it and crooning about how NICE it was. A woman of taste and discernment!