Compost in a pile at the edge of the garden or out-of-the-way spot on the ground is far better at supporting growth than the same compost in a container. Compost is VERY water-retentive in a container - even when mixed 50/50 with perlite. Excessive water retention of compost in a pile on the ground is largely eliminated due to the wicking ability of the mineral soil beneath the pile.
The size of particles that make up a soil or grow medium is largely what drives water retention, so collectively, the tiny particles that make up "finished compost" is always very water-retentive in a container, and compacts readily. If the compost is still chunky, it's 'unfinished', meaning the composting process is still ongoing. Unfinished compost tends to immobilize nitrogen, making it difficult to supply enough N w/o over-supplying other essential nutrients.
You can make a very productive and easy-to-grow-in medium by mixing 70-80% pine bark (size dust to about 3/8") with 10-15% each of perlite and either compost, sphagnum peat moss, or commercial potting soil, with an appropriate measure of dolomitic lime added to adjust pH.
Al