It would be helpful to know what you consider "regular room lighting." Are you talking about living room lamps, kitchen ceiling lights, south-facing window, north-facing window...? Also, knowing your location helps. But that's mostly to advise you on the basil.
Rosemary and thyme, no. They need to be outdoors in full sun or under full grow lights. Neither will last long in a pot indoors without direct bright light. Sure, you can straggle them along for a few months, but they won't thrive for long.
Sage can get by with a bit less sun (duration), but still needs bright light for about half the day. Like the other two, it will do better outdoors or under grow lights.
Basil, yes/no/maybe—it completely depends on what kind of light you're talking about. Needs to be directly in a south-facing window, assuming you're in the northern hemisphere.