But what if you link in just the functions you need, vs having the enormity of Library X on your disk that the package manager put there because it can’t know what you actually use/need?

Sure, but generally Library X is already on your system because someone else needs it. So why not use it if it's there?

Maybe you want it in a container with minimum dependency