Just had a thought.
Mentioning no names, I bought some cheap Jobber drilll bits on ebay, supposedly 'quality' items.
After the first 2 sizes snapped on the first hole attempted the rest went in the bin.
Maybe your trouble is naff drillls and what you really need is a Dormer?