That does not look like either a ficus or a sugarberry trunk. Check out the fruits too, they look different than yours on both trees. The leaves on a sugarberry are not as shiny either.
See sugarberry here:
http://www.wildflower.org/plan...
" Its smooth, pale bark is marked with lighter, corky patches" and it's deciduous. Is your tree deciduous?
As far as ficus, it's not reputed to live as far north as you are.
http://hort.ifas.ufl.edu/datab...
