I normally include an electrolytic cap on the output of linear regulators, then add a ceramic near the input of anything that may be affected by noise.

Although things may work without caps on the linear regs, it's not good practise. Lots of linear regulators specify minimum capacitence on the output lines in their datasheets.