oh.. a car buffer is softer than the one I was imagining... it's a wheel which you charge up with a compound.. much more agressive... as I was thinking..... a bit of time in the oven.. on a bit of foil... the paint will melt some... but as it cools at different rate than the ball... after it might flake off easily.. or can be scraped off warm
maybe just some paint remover.. peel it away..