Just keep the deer and rabits out of your fenced in area. Then slowely expand that fenced in area. You have so much room there. If you always see deer in your yard behind that fenced area I wonder if it might help if you planted a meadow with a deer mix. That is a batch of seeds of plants that deer love to eat. I am thinking give them food and they would leave the garden plants alone. There are places you can find on line that sell this sort of mix. Hunting preserves use it to bring in the deer by having deer attracking meadows.
