Germination is very erratic. While some will germinate without cold stratification, they do better when exposed to 30 days cold strat in the fridge.
And yes - cleaning the seed is a gaging experience the first time -- they are very rank.
Under optimal conditions they will grow about 6 - 12 " a year.
It is very hard unless one wants to spend a lot of money to determine the sex. Typically, it takes 15 - 20 years growth to determine the sex without testing.
I have been growing them from seed for 3 years and sell them at a local farmers market. Typical germination is 30 % or so.
People in the far East, particularly China, love to eat the fruit.
Leaf drop is interesting as a tree will typically drop all its leaves in a very short time - as little as 24 hours.
The leaves also do not break down very easily and are not a great additive to a compost heap.
Larger drug stores sell ginkgo pills that are good for memory - particularly the elserly.