I don't know about ginger, but wouldn't canna have to be dug up in zone 5 ? I know I couldn't leave it in the ground over the winter where I am...
Linda, foxglove (digitalis) would probably do well there for you, too... it self-sows pretty freely in my shady spot, so there are always new plants coming along.