Yes, that has roughly been my experience. The application throughput offered by IPFS is quite low while the packet throughput is very high. I was experiencing 5-15% packet loss over my internet connection while running IPFS. I'm not sure if a bandwidth limit would even help or if it is related to number of connections.
Is it possible to limit the bandwidth and queue depth for IPFS?
I bet you could also lower its limit dynamically whenever web traffic is seem.