Agree with that, but that's better represented by modelling poor agents as systematically transferring small portions of their wealth to the rich rather than randomly losing or winning large portions of wealth.
But the randomness is what hides the transfer. Poor agents are forced to choose out of some set of bad outcomes. Some of them can win, but as a whole, no.