Are the leaves showing any color yet? Any fruit, seeds or nuts? Evidence of past flowers? They look too small to be a Persimmon.. I considered Styrax japonicus... but it doesn't look right..and I'm not sure about the bark.. I think the bark is smoother on Styrax. The other tree I considered was the Fringe Tree (Chionanthus virginicus). It has rough bark and has an awkward growth habit.