No, not like that. Move the 'wall' in the middle of the block to the edge, and have one plate on the other side to press the bearings against that. Have a look at the BK/BF blocks on eBay/Zapp if you're not sure...

The way you've drawn it makes it harder to machine concentrically. The standard way only requires one hole to be bored.