There are many species of epilobium. I found a website that said Epilobium leptophyllum (narrow leafed willowherb) drew Japanese beetles away from roses! So I assume the species that draw hummingbirds probably would be attacked by Japanese beetle as well. Other Epilobium species are known as fireweed.
