Wild ginger (Asarum canadense) survives my zone 5 winters. Never notice the flowers since they're pretty insignificant. Mayapples (wild - not planted) survive here but they will look pretty ratty by the end of summer. You might want to look into bloodroot (Sanguinaria) always has perfect daisy-like flowers in early spring.
