Cut off the yellow stem at its base rather than trying to pull it out. Do remove or loosen the top layer of stones, but you don't need to repot. Removing the top stones will allow you to more easily water. Try to keep the water level up close to the rim of the pot. No need to worry about overwatering it.
