> So there's some strange sense in which these laws of nature seem to arise from, or are at least deeply connected to geometry.

Alternativey, geometry is how we choose to formulate our understanding of the Universe's behavior.