I seriously raised registered Nubian dairy goats in the 80's - 90's.
The Nubian's milk is higher butterfat and better tasting than the Swiss breeds.
As for stinking, the does do not stink, its the bucks that have the strong
musk smell during the breeding season. During the off season its not quite as bad.
I've had raw cows milk that tasted "cowy" so its not just a goat thing.
We currently have a cow share and the milk is superb even though its from a Grade B dairy.
I think flavor of the milk depends on the stage of lactation and how the animal
is milked and how the milk is processed aferwords.
I was meticulous about clean udders, wasting the first few streams of milk
which is highest in bacteria,
performing mastitis tests regularly and using bleach cleaned stainless steel equipment...
and my milk was filtered and plunged into ice water to cool quickly.
Most people could not tell the difference between my goats milk and the milk they drank.
So this topic is very subjective depending on the many variations that can occur.
A side note on the wonders of goats milk.
Due to the fat globuals being smaller and naturally dispersed throughout the milk
people who are allergic to cows milk can often drink goats milk.
It's an ideal food for growing youngsters and the elderly
and much better for you than soy which has plant estrogens and is why
it is only suppose to be consumed no more than 3 times a week.