How do I stop this coming loose?

I bought two new pannier bags, which have these adjustable clips. They come loose every time I ride, and the bag itself detaches from the clip. I complained to the manufacturer, they sent me another, but it's the same. So am I doing something wrong? I thought about just glueing them in position, but surely it should just work, and remain affixed?