I think you'd struggle to get a different motor that would be a direct replacement.

Is the vibration a mechanic vibration, or an electrical stutter?
I'm assuming this uses a DC motor, in which case the SCR type controllers can fail and cause motor stuttering.

Personally, I'd look at fitting a servo motor, but the 5000RPM requirement would likely involve changing the drive pulleys to step up the speed.