When you keep moving it back and forth it makes it harder for them to acclimate. I do move my plants only if there is a verifiable weather event approaching like very strong winds, or frost advisories, also depends if I can still move them since some are really too huge to move. So if I am unable to move them, then all I can do is to cover and protect them.
We also have distinct seasons, so in your case, eventually you will have to move your young plant indoors for overwintering. In the meantime, allow it to grow new leaves and take in whatever natural light and warmth it can take outdoors. Remember in part sun for now, to avoid undue full sun distress.
But otherwise, I let them harden themselves to whatever is happening outdoors. Especially if it is in such growing distress, just got to nurture them patiently, no fertilizers, it needs to recover nicely first.