Spacers on MTB

Am I ok to remove all spacers from the bottom? Do I need at least one spacer between frame and handle bar?

by Banzapata