Need tips on removing the end piece so I can put new grips on

Why does it seem like it built to not come off? I’ve scratched the fuck out of my handle bars trying to pry them off. Am I retarded?