This is the eternal question . . . what will stop the deer.
I have lazy deer and a fence of 4' seems to stop them in the flower garden, 5' around veges. Some people swear it takes a 12' fence, they have very hungry deer.
I've heard on a hillside you can get by with a shorter fence, but as I said my deer are lazy and I've never seen one jump over anything.
A double fence works well too, I put one of those in and they are smart enough not to jump into something, like another fence, in the way of landing.
My suggestion start with 5' and plan on putting in a double fence if they are jumping it. But I personally don't like the stalag 13 look of a high fence.