Just to say I finally worked this out. The adapter has a threaded bolt at the back of the taper, so if you remove the tool and then reach up inside the chuck with an allen key you can unscrew it and get it off.