Always! My heavy outdoor clay needs it badly. And even if a pot has "salted up", dilution with other soil, and rain, will soon flush it clean outdoors.
I've been making potting soil with mostly screened pine bark lately, and I thinki that's great ofr the soil.
If I was worried, I would add it to the compost heap first to dilute it aqnd allow benficial microbes to displace any wierd life that had accumulated in the pots.