Most likely too much P or D. Start off with I and D at zero and go from there. The steady state error is taken care of by the I term, so if PID tuning is indeed the issue, that's most likely where your solution will be found.