it does make sense. I have faced the same issue. To make it work, I usually make a sketch in the model mode and use that as the profile to mill from. Otherwise, select the inner most chamfer edge and set the heights accordingly