Handlebar grip compatibility

I wanted to replace the grips on my trek fx2 but when I removed them I realised the handlebar has this rubber built in — do I need a new handlebar to fit some ergons on it? It seems the plastic end caps won't fit in