If you can leave them until they get a good frost, they will have a better flavor, but if they begin showing brown leaves on the sprouts, it is much easier to clean them if you remove them at that point. Yours look as if they might not be ready for a while yet.
