I sent the photos to my brother and he also suggested blackhaw viburnum. However, I don't think my tree has ever produced any berries. I don't even remember the flower buds opening to full flowers. I could be wrong about that. I'll have to closely watch the tree next spring. The leaves certainly look like viburnum, though, and I know my dad, who planted it, liked viburnums. There is a Korean spice viburnum in the same garden bed.
I just read that viburnums need cross-pollination to produce berries. That would explain why my tree does not.