I don't get that many fish bones, but I do chop up chicken bones and also put crab shells in my compost. Takes longer to compost, but I just throw it back in the bin when I scoop out the good compost. Seems like the organisms go after the marrow in the bones first. I do keep a cover on my bin when I do that and also bury it under other stuff when I add it.
