I would generally consider upper class to be wealthy, of course it's not a very specific term, individual definitions are going to vary greatly. A successful SV engineer old enough to have kids can easily be worth a few $million. That seems wealthy to me, but it's a subjective measure. I guess you could survey a bunch of people to try & get consensus on it, and evaluate the benchmark from there.
He wasn't especially wealthy growing up, to be clear. Upper class yes, but no more "wealthy" than a successful silicon valley engineer's child.