If you are putting the extractor outside then inclose it and put a fine particle filter in the wall between you and the extractor.
You will not then need a separate fileter and all your heat will return!
Mind you will have fun sealing the outside hut!!
peter