The reason that these warnings exist is because most people just don't have the space to let them naturally romp away and they thus can outcompete/bully other plants in the vicinity, effectively creating a monoculture that most likely won't appeal to a gardener with only a few sq. feet and a 'lots of plants' ambition.
And usually once these plants take hold, they're difficult to get rid off again too.