Answer: Aphids are sucking insects and can damage small plants in a hurry. Aphids are also very prolific so you need to get them out of your windowsill garden as quickly as possible. It might be wise to isolate your pepper plant so the pests don't spread to your herbs. Since the infestation is small, you should be able to control the aphids by squishing them as you rub them off the leaves of your peppers. Or, take the containers out to the driveway and hose the aphids off with a strong stream of water from the hose. When you're sure they're bug-free, take the plants back into the house.
Pepper plants need all day sunshine and warm temperatures to flower and produce peppers. You may need to take your pepper plant outdoors so it can bask in the sunlight and have insects visit the flowers for proper pollination. If you keep your pepper plant indoors it may not flower. If it does flower, you'll need to transfer pollen from flower to flower just as flying insect would do.
Best wishes with your windowsill garden!
Q&A Library Searching Tips