You could try putting the pennies in 2 of those mesh bags fuit comes in from the grocery store. That way you could just pull the bags out, wash & refill the bird bath & throw the bags back in.
OR
You could go to the hardware store & get a coil (ice maker tubing) big enough to go once around in the bath inside like a hoop & then everything would be very easy to deal with.