Are you talking about your vegetable garden or your perennial/annual whole yard garden?
After I pull my veggy plants in the fall, I dump all sorts of things on my garden. It seeps all winter and is ready to be dug in next spring.
If its your regular garden, spring is best.