Is this a problem?

My new stem is a little higher than my old one, so there is some space on top. Can I leave it like this or should I remove a small spacer?