delawaresu!
The cilantro likes sun but will bolt as soon as it gets too hot. It will reseed so after you have it planted you may not have to plant again. You can probably plant your cilantro outside in the next few weeks. I planted some already outside but also started some seeds inside yesterday. Oh, I am south of Atlanta, near Newnan, so we don't have too different of weather.
I start my basil now, in fact, I just planted seeds yesterday. You didn't say if you were starting seeds inside. If not, you will have to wait until about the end of April to plant direct outside.
Rosemary is a slow germinator and grower. I have grown it from seed but it can be a challenge so I usually just buy a plant for a start and then take cuttings. If you're new to planting seeds you may want to try that.
I have thyme and oregano but I cannot remember if they were touchy or not. I think thyme is fairly easy. Both are low growers so they could be planted in the same pot with your basil.
Good luck!
