To my eyes, The fruits and leaves looks more like a Prunus Sp, like choke-cherry (Prunus virginiana), bird cherry (Prunus padus) or other similar species.
Huckleberries has a ring/crown thingy (calyx scar) at the top of the fruits, like other Vaccinium (Blue berries) species, and the leaves has very small teeth at the margin, almost looks like smooth from a distance.
The mystery fruits has bit obvious serrated margin
To better ID plants, it is better to have more images, like leaves and fruits still attached to the stem, branch, bark, whole plant image etc. Detached leaves and fruits can be ID sometimes when it is obvious and unique, but in many case, it is not enough.