Removal is your decision.
The general guideline for hard pruning is to remove no more than a third of a shrub a year, although some varieties can withstand quite a bit of periodic pruning throughout the year. Not certain about the Golden. Best time in your area would be early spring, I'd imagine.