Why do you keep pulling the babies off? What are you doing with all the babies? This plant is supposed to be an entire cluster of plants, not a solitary.
The pot only needs to be slightly bigger than the root ball but the roots need to be IN the soil, not ON the soil.
If you are uprooting it to pick off the babies, don't. Its causing a lot of stress and your plant is reflecting this.