Ignore the voltage rating for different motor frames, it's a complete red herring. The issue is how much current you can drive through the motor and bigger motors tend to have high inductance and therefore need higher voltages to get speed out of them. Those drivers are limited to 3.5A by the chip but don't really have enough heatsink to handle that current which is why they fry.