Okay! See what happened now when I tried the leaves and stem. I havent't watered it for about two weeks now. Leaves are all a bit soft.
As tarev pointed out, maybe it's the wrong kind of soil I have there. I checked out the soil more thoroughly and it a bit moist in the center.