I keep a lot of perennials in pots , mostly because I am indecisive and not for display.
I think the problem you may have with display perennials they don't flower all year like annuals.
But they do well with annuals
I have :
coral bells
ferns
Hosta
Penstemon
hardy geranium
sedum
coneflowers
spiderwort
lavender
dwarf iris
small daylilies
dianthus
brown-eye and black-eye susan's
there are many more, the above are currently in pots , overwintered in zone 5