For example AirBNB talks about 2000 web servers with Rails. I bet they could be 200 web servers with Java. So because of Ruby, we have 1800 servers burning coal in a datacenter somewhere.
Indeed. And to be clear - I'm not saying everyone needs to do everything bare metal. But more often than not, inefficiency comes out of people's laziness. But that very laziness gets dangerous when multiplied millionfold, which is what happens when a service gets popular. Therefore I think making things efficient deserves at least a passing thought.