wirebrush , if you dont have an angle grinder , then maybe a drill ? wirebrush attachments work great !

if not by hand ...

but as mentioned , if the paint is sticking , id use it as a primer and just paint over after wiping down with thinners/acetone