There are a few different factors that could cause bump steer and 'drifting'. One thing to keep in the back or your mind is the crown of the road. A lot of people don't understand that the road is not flat. It's curved, or crowned on the top so water doesn't puddle.
Now I'm far from an authority on this one, and specific degrees are not my forte, so I'll try to wing it.
It's a YJ, so the only rear alignment that could be done on this is the toe. Toe in or out is the direction the tires are facing. Follow this link to some alignment basics:
http://www.familycar.com/Alignment.htmIf the vehicle is aligned correctly, this could eliminate some of the drifting. What is difficult to do, is to fix the caster. In order to change the Jeeps caster, you must also change the pinion angle. This causes front drive line vibrations. So you've gotta find a 'happy medium'.
Then there's bump steer... That's too difficult for me to explain, and this web site I found has a bit more to do with racing than Jeeping.
http://www.bakerprecision.com/longacr17a.htmThe idea is to keep your tie rod at the same plane are your drag link. If those two pieces are as close to the same plane, you'll help in eliminate that issue as well. Drop pitman arms help with bump steer, high steer or over-the-top knuckles or tie rod ends.
I hope that this clears up some of your issues, or at least informed a few of you. A disclosure on my behalf... I'm the furthest from an authority on this subject. This is most of what I know on this subject.