Agree, those are aphids..milkweeds are such magnets for those. I just do the same, a good hose down, or sometimes if my milkweed is in bloom, I use alcohol/dishwashing liquid swab to gently remove those, doing it before the sun hits the plants. Or, if I can find a ladybug, I move it to the plant with aphids, so it can have a lovely meal.