Tangential - the laws of nature discovered by our brain usually involve just few quantities, like f=ma. On one side it is a great ability of our brain for analytical reduction, on the other side it is just an inability to deal with complex multiparameter phenomena without such a reduction. I wonder if pumping more and more data into the NNs we'd be able to distill emerging multiparameter correlations which happen to be new laws of nature irreducible to more simpler ones.
I disagree, our brains almost always deal with complex multiparameter phenomena.
The part of us that can't cope with that is our System 2 reasoning: our minds' rules based thinking is great at F=ma but cannot enumerate the rules necessary at the level of retina cell activation patterns to recognise a tiger; our System 1 can, and always does, we just call it "intuition" or "common sense" or "a gut feeling".
Eh, not in this context at least. Nature is a big term. Physics just "is". This makes it a good place for simple mechanics to appear and be derived. You can argue around how universal that is all you want but proteins themselves are the result of an enormously large search of a hugely high dimensional space. It doesn't seem possible for them to ever be reduced.
