Answer: The little pups can be separated off and planted, yes. Your banana should be relatively fast growing if the temperature is at least 55 degrees, it is in extremely bright light, and the soil is rich and evenly moist (but not sopping wet.) Wintering indoors it may not be receiving enough light to grow vigorously. Also keep in mind that digging it up causing major root loss will unavoidably set it back somewhat. You might consider growing it in a large container if you want to keep it in active growth year round.
Your zip code places you in zone 7A, the coldest part of zone 7. In a sheltered spot it might be a half a zone warmer, or in an exposed site it could be as cold as zone 6. Some people are able to overwinter their bananas, depending on the variety and the location. Your banana, Musa acuminata "Zebrina", is typically considered hardy only to zone 10 (maybe 9 with protection) -- think southern Florida -- so it would have a chance in Maryland. If you want to try one outdoors year round, look in the hardier types such as Musa basjoo (hardy fiber banana) or Darjeeling banana, Musa sikkimensis (M. hookeri).
Q&A Library Searching Tips