Same here - the horse doesn't belong to our neighbor. They rent the field out but I met the owner once and asked her if I could feed Pepper carrots and apples and she said yes and I also asked if I could climb the fence with a bucket or bucket(s) and take horse poop and she said YES
