Well, I finally got my fat ass under the Jeep and found that the U-Bolts did indeed need tightening. As a matter of fact, the drivers side bolts took about 3 turns each! The passenger side was loose too.

There was a noticable improvement - the problem is still there, but it's one hell of a lot better, thanks guys!