While I have had to do a fair amount of moving things around, the scheme idea has worked out well. Whenever I acquire a new plant, the color dictates which areas suit it. While bloom times vary considerably from one region to the next, and often from one year to the next, at least the combos I end up with are within a particular color palette.
After moving, I ended up with several lost tags. So I installed a butterfly/hummingbird garden that we see from the back deck, where its chaotically polychromatic. That's where any no id plant material went, and still goes today.