That's pretty much how we handle it, Chelle. Once spring hits, we don't feed anymore.
I'm also very careful and observant about the natural vegetation in the area (Beautyberry, ect) providing lots of food (or not) for the birds. Some years we need to help them out more than other years.