David ...
Outside all you need to do is wash the plants off with a strong spray of water. You don't even need the soap. For a severe infestation, you may need to do it daily for a while until you have broken the breeding cycle.
For delicate plants, just put your hand behind the part of the plant you are spraying.
When I was growing plants in containers outside, I also put a few cinnamon sticks in the container to keep ants from farming the aphids.
I haven't grown plants indoors, so I can't suggest the best way to handle them inside. I guess it depends on your set up.