Horses use their necks as a balancing beam. Something must be off with his balance. I would have a vet check him. Have you tried lunging him before you get on to see if he does the same thing? Sometimes you can see things from the ground much better than when you are riding.