I'm thinking the way your house is situated you don't get much shade in your backyard until the shadow of your house encroaches on it. Here, my west side backyard neighbors have a couple of huge trees that right now are completely shading my backyard. I can usually find an area to work out there after 5 pm. I haven't checked on my succulents yet... I am using a bamboo shade screen (one of those meant for windows) and some other things to shade my containers, mostly those netted flat trays leaning against containers to break up the sun rays.
I wait till the sun is actually down to go out for my daily walk (I really can't take the direct sun for very long either). Right now it is about 90°.
