I'm far from an expert & don't know what kind of lavender you have, but I've always thought you weren't supposed to prune back to the woody stems. Lavender are relatively fairly short-lived & will become woody, after a while - whenever I've had a portion of a lavender plant become woody, I've had to prune out that part of the plan. Please take my amateur opinion with many grains of salt.
