Kabby, do you ever wheelbarrow soil back and forth between the two sides of your yard? Or hire some kids to do it?
Having sand NEAR clay gives you an option that almost no one else does: make the top 8-12 inches 50-50 sand and clay, giving you sandy clay ...
... if you can move 3 cubic feet of sand and clay from one side of the yard to the other,
per square yard of garden. That gives you a 4" deep layer of clay over sand (or sand over clay), before tilling it in with added compost or other organic matter.
If you have ANY silt in your soils, that would give you clay loam or sandy loam in the top 8-12 inches.
If you have a 6 cubic foot wheelbarrow, each round trip would amend 4 square yards (2 square yards on each side of your yard).
A lot of work ... but might make some great soil.