Rob, if the surface finish isn't critical, then some form of linisher should work. Even a flap wheel in a drill, or flap disc in an angle grinder, but you need to makes sure you clean it if it clogs otherwise you'll just be rubbing aluminium with aluminium.

I hate working with generic sheet aluminium, as it's akin to working with butter.