Got in contact with Mach and they suggest that it is me moving the axis while it is waiting to start the next operation.
No idea why it would move the machine cords but Reddit also agrees that Mach3 does not like to move mid Gcode...

Switched back to splitting my code into multiple files for each tool. Worked fine. Doesn't add time, does increase the possibility of me picking the wrong file though xD