Thanks to everyone for all the help identifying. There must have been seeds in the soil we bought in last fall, it was supposedly organic soil. It was all tilled this spring before planting. Hopefully they don't come back next year. They'll be gone soon enough, fall is almost here.
Thanks again for the help!