Looks like they are looking for a good nesting space , the holes look just made for them
as for what type of wasp I can not say because I am sure we have different wasps in my area .
It looks a whole lot like a small parasitic wasp. They lay eggs on various caterpillars here. Like horn-worms that like my tomatoes
If they are not bothering you I would just let them be
If you want to discourage them wasps seem to dislike peppermint
I use a spray to keep the paper wasps from my doorway.
