I use a mix of a little dish soap and water in a squirt bottle. Once I see the good bugs move in, I stop spraying. That soapy water can kill them too.
If you see ants by your aphid infected plants, kill them too. Those ants will farm the aphids and move them to other plants.