Are all pieces there assembled like that?

Click image for larger version. 

Name:	download.jpg 
Views:	334 
Size:	6.7 KB 
ID:	17688


So if the whole bearings are moving in the housing, then shim the OD of the bearings. If only the ID of the bearings are moving, then shim only the ID. When shimming, dont shim between them, but outside in both cases.

If not freely rotating, then something is not right. It must be something simple, so just check again