Answer: If at all possible, it is better to let them alone since these insects are very valuable to the environment as pollenators and in controlling pests. But if they are in an area where you frequently risk being stung or if you have an allergy, then of course you would want to control them by treating the nests with carbaryl (Sevin). The following article includes information on how to do this.
I hope this helps.
Q&A Library Searching Tips