Leave them until they turn brown. It "softens" a little as it starts to dry due to the liquids leaving different parts of the pod. When it turns brown eventually it will get to the point where the pod starts to crack. When that happens, take it off and place somewhere to dry. I've made the mistake of putting it in a plastic bag or something else that doesn't allow free airflow and the pods can and will get moldy. Just finish letting them dry and break open to get your seeds. Good luck!
