This random idea popped up today, and I'm definitely on both teams. We built our house which took several years (mostly on cash basis, hence the delay). There was never any particular time that we sat down and thought, what about the yard? Initially we started weedwacking the thistles and nettles and eventually mowing the incoming pasture grass. We fenced in and tilled a vegetable garden in the sunny front yard. The rest just kind of slowly evolved and we randomly added hardscape to better define beds and walkways. I received lots of plant starts and young saplings from friends and neighbors, which were plopped in the ground where there was room and then moved as I better understood their needs and growth habits. As the garden beds emerged, I would go to the nursery with a rather vague list that might read "something red in front of the lilac" etc. Or a particular plant might catch my eye and then I'd have to figure out where to put that.
Now to the planning: As I sit in the evening enjoying a glass of wine, I look over the garden beds and make notes of what needs to move where, what is missing, where there is too much of the same color, etc. Over winter, I then make up my Wish List for the following season, along with a to-do list of things to move. So my style is go with the flow first and design second. Probably inefficient, but certainly enjoyable.
My husband absolutely does not understand why I keep moving and moving the same plant from one spot to the next (often I am really dividing) and I likewise don't understand his enamor of hitting a small round ball around a course over and over. We get along fine.