And adding sand to clay would probably make it turn into something like hardpan.
Philip has hardpan and gypsum would be the perfect answer in his case. When I lived in the Central Valley, there were companies that came out and dynamited a hole in your yard so you could a plant tree.