Name: Carol Santa Ana, ca Sunset zone 22, USDA zone 10 A.
The only thing to worry about with your plumerias is that the ants may be bringing scale or mealy bugs. The ants themselves won't harm any plant, but they do "farm" other insects for the honeydew.