I've been pulling up oak seedlings in my garden all summer. No idea how the acorns got there so I blame squirrels even though I know of no oak trees and no squirrels near the fall garden.
Anyway, the seedlings keep coming up in the full light areas, with 10 to 12+ hours. Tough little things. If you know where that's going to go long term, I'd suggest putting it there. Oak trees don't want to be in a pot.