all the props were in the correct place, maybe one motor had the prop facing the correct way but the motor spinning the opposite way. but it did fly level and I imagine it wouldn't if a prop was forcing air in the wrong direction.

So i conclude that it must be a gyro thing.