I would disagree. "Difference of affinity" is in my opinion one of the main factors. The real question is where does this difference come from and my best answer to that question would be nudging. And this nudging is exactly addressed by quotas. They are not there to make the numbers look nice.
I believe we have established in this conversation that people claiming "difference of affinity" are just covering over their biases.