In fact, it isn't even completely true in Europe. Early Medieval serfs in Northern Europe also wore trousers, but rarely, if ever, rode. The major point, shared by your Chinese workers, is freedom of movement and aversion (in Northern Europe driven as much by climate as modesty) to nudity. Protection, as from brush, is another factor, but more an occasional one, rather than always present.