Try some locktight, can find it at a carquest store

check for wear ,you did not say if flange bolt or pinnion nut ,if isis the pinion nut the crush sleve beteen bearings could need replacing. try lock tight on the threads will hold most bolts in place.