If you have a lot of holes to do might be worth investing £5 in one of these Abrasive Sanding Flap Wheel Mop 30mm KLINGSPOR

The other way to do it is put a sawcut across the dowel and press fit it into the hole.

Phill

Click image for larger version. 

Name:	Klingspor.JPG 
Views:	243 
Size:	44.5 KB 
ID:	28650