Horses like to be dirty. The only other thing I can suggest is just picking it out by hand (gently) where it might interfere with tack. The first thing mine do when I turn them out after grooming is to find the wettest possible place to roll in so they can be nice and filthy again. I do not know why they do this, but I do know the frustration.
It is never the horse's fault