I think if you prune, there will be two consequenches. First, you will cut off the branches that will make your tree taller. Second, once you prune a tree, you have interferred with the natural growth habit. And you have to continue to prune.
I suspect you have to give your tree time to fill out. People who cut the main leaders out of Holly are trying to keep them shorter, not make them taller.