How do I remove this seat clamp from the telescope seat post?

I want to completely remove my telescope seat post as some dirt got stuck between frame and seat post.

I'm struggling to remove this clamp around the seat post. What's the trick here? I removed the screw yet that thing simply won't come off and I'm afraid to break something by brute forcing.