Hi & welcome! The moss sounds amazing! So beautiful, soft, does not need to be mowed. I would consider it a lovely gift, not a detriment. It should not stop you from adding whatever site-appropriate flowers or shrubs that you had in mind.
You'll probably end up with moss-covered gravel if you try the gravel route. Pea gravel is hard to walk on too, if it's smooth. It rolls around under the foot.
Pics are always helpful to solicit the most relevant replies, if you are able to add one, or more.