I've seen brown bumps like that in the past on some of my semps and just assumed it was insect damage. They seemed to grow out of it.
Sorry to hear about all the aphid infestations all over. What a bummer. Every year it seems like there is some kind of critter problem for some of us. You'll have to invite a bunch of ladybugs over for lunch - they love aphids!