I'd be wary of putting a 35v rating capacitor on there permanently, the back emf could easily get to 45+ volts and lead to premature capacitor failure.

Makig a linear power supply is easy. Its hard to find ready-made linear supplies as there's little market for them outside the CNC world. I'd be happy to take you through it, almost no soldering required!