It can be done, and it sounds like you are going to use enough amendments for proper drainage. I would not use potting mix with fertilizer in it. I use ProMix BX.
Make sure you put the newly potted plant in morning sun only and make sure it doesn't get too much water.
Going forward, a raised bed or on a slope would be best.
Good luck, and post some pictures here.
