Can you post a photo of the fountain to give us a better visual.
We have a concrete fountain too, but we never had to caulk it..it is quite heavy.
Just make sure you think very well where you will position that fountain, hard to move it once already there, Consider too how near it is to your water source, will your garden hose be long enough to reach it so you can refill it easily as needed. During summer time I have to refill very often since there are no rains, our temps gets too hot so evaporation is very fast, and humidity is so low, just very dry here all over, which accounts for frequent water refill. Think of which plants will benefit it more. I positioned mine close to my orchids, so in summer there is some good humid cross wind somehow.
Fountains will scatter water all around, so the plants around it should be ones that will not mind getting too much water.
Right now my fountain is turned off. Since most of the orchids are hiding indoors anyways. and with rains around, no need to run it.