Hi, Evan:
Those little fruits that look like tomatoes are in fact the true "fruits" of potato plants (as opposed to the tubors that grow underground). These fruits are not edible, and in fact contain large amounts of solanine, which is poisonous. I would not recommend eating them. Certain varieties of potatoes seem to set more of these fruits than others. (Yukon Golds are known for setting them).
Linda