We used to put cinnamon in the water at home and away. Made it taste familiar, and never had an issue. Another, not as easy, solution would be to bring a couple of containers of your own water with you. We do that when we take them to the beach, and use those largish plastic cat litter containers with screw on caps.
It is never the horse's fault