I think that will be okay, it's a method used by many people. Velcro might be another idea if you don't fancy the magnets.