I don't know what it is either but I can tell you that it also grows in zone 10 Florida even 1 mile from the ocean so it's able to take salt air & that zone plus terrible drought. I've lived with this plant most if not all my life as I said before. It was always a "weed". Like you say ginger --- just pops up, no care, no nada. I have no clue if it's a native or an invasive.
Since you posted it I'm curious to know what it is.
I hope Myriam & Janet can solve the riddle.