Another sizing question

Am I crazy for wanting to try an XS?

I’m 180 cm tall with an 80 cm inseam.

Although I have short legs, I have long femurs relative to my shin length so I’ll likely have my seat set back quite far which should effectively increase the reach and requires a lightly lower saddle height.

My current bike feels a bit big and its reach is only 15mm longer, 25mm including the aeroads shorter stem. There is always the option of a longer stem as well.

My concern is the stack of the XS aeroad. It’s 46mm which feels like it could be a lot. I can cut that to 26mm using spacers though.

I’ll have a saddle height of around 690mm and canyon says the minimum for the small is 684mm. Not sure if that’s a recommendation or a hard minimum.

Last note is that I don’t mind being in an aggressive position. I can ride my current frame in the aero hoods position for a while comfortably.

I do plan on going to my LBS to test these measurements out but would love to hear thoughts from anyone, especially if you’ve sized down in a similar way.