Yes, the plant does not want to be watered too often. The soil needs to dry before you water again. Maybe water once every 10 days? Also, they are not crazy about too much sunlight and don't like a lot of wind so keeping the plant either indoors or on a protected porch may be best.
You may want to consider getting a different pot and re-potting with fresh soil. Sometimes salts will accumulate in the soil so starting fresh may be a good idea. The pot needs to have drainage holes.
Cut away the dead/discolored leaves and discard.