Matching growth habits of the scions can be tricky...so one doesn't end up with a lop -sided tree, but ive seen a picture of a beautiful tree in Thailand, the tree is over a 100 years old, with over 80 different cultivars. And there's a fellow in Oahu who's grafted dozens of varieties onto a tree over a 20-year time span....
(You can find pics of these trees in the book "Frangipani " by Linda Ross, Lorna Rose, and John Stowar. It can be done over time, with careful consideration of ones scions.