Indeed, I took it to mean that OSS guys only build from source, or something along those lines.

Proprietary software uses binary formats, yes, but interchanging 'proprietary' with 'binary' is a bit confusing.