Compost which has been properly aged, completely composted, cannot burn your plants. If you use compost that is too fresh, not yet broken down, has not completed the cycle, then yes, it can burn your plants and can compete with your plants for nutrients/nitrogen.
Do you make your own compost? or are you buying bagged compost?