Answer: Based on your description I am not certain what your plant is, it would be helpful to know what season it blooms and if it is growing in sun or shade and what size the plant is. But, here are some possibilities that came to mind.
Is it Carolina Allspice or Calycanthus floridus? Here is a photo. You may need to cut and paste the complete url into your browser to make it work correctly.
Is it Hearts A-Bustin? This is also a native plant, Euonymus americanus, and the flowers are unique. Here is a photo.
Or it might be an Abutilon?
I hope it is one of these!
Q&A Library Searching Tips