I'll Bet 50p you have them in wrong way round.!! . . . . Possibly crushed spacer with over tightening.? (which you shouldn't have to do.!)
Never had a spacer short enough to cause this, usually just lets nut or screw catch seals if short.