The problem is that the things you identified as being based on luck have cascading second-order effects. For example, people that are perceived as handsome have better chances in wage negotiations, and the same goes for people with a lighter skin tone. The most strongly connected trait to being financially successful: being born in a rich and educated family.

These things are outside your control, but entirely in control of a society.