Ok, I dare you to go up to someone and say, "You're medicore and unambitious -- not that there's anything wrong with that! It just means you're not as intellectual as me and I probably wouldn't enjoy working with you."

You can judge by their reaction whether they think you're saying something about what kind of person they are.

I still maintain it says more about you than them, though.