Only a suggestion, a ghastly, unauthentic bodge that may cause you to vomit, but here goes :rofl:

Turn and bore the bearings to size.

File the externals so they can fit perfectly in line

Jig up square and all assembled

Inject Loctite (or metal loaded epoxy if slack), in to wherever you poured the molten metal before

Robin