I have no particular expertise with citrus, and only have a single plant, but I would not think that would be a problem at all. After all, citrus are grown in the ground, so what's the big deal about a large pot/tub/barrel? You still need well-draining soil and plenty of large drainage holes in that barrel.
I am sure others will have more experience and not just give you a "guess".