Answer: Depending on how far inside the siding the nest is, it may freeze during the winter and thus not be a problem for you next year. If you know specifically where the yellow jacket nest is, you may be able to remove it during the winter months; or, you could trap them next summer. Or, you might consider using a specifically targeted chemical control such as carbaryl (Sevin) applied only to that particular nest. If you have someone in your family who is allergic, for instance, this might be something to consider despite not wanting to use chemicals on your property. Your local county extension should be able to help you with determining the most effective timing for your control efforts. In the meantime, you may find the following article helpful in planning your strategy.
I hope this helps.
Q&A Library Searching Tips