That's the problem with sarcasm...

You need to publish this tbh

Depending on what your usage requirements are, Mac Minis running UMA over RDMA is becoming a feasible option. At roughly 1/10 of the cost you're getting much much more than 1/10 the performance. (YMMV)

https://buildai.substack.com/i/181542049/the-mac-mini-moment

I did not expect this to be a limiting factor in the mac mini RDMA setup ! -

> Thermal throttling: Thunderbolt 5 cables get hot under sustained 15GB/s load. After 10 minutes, bandwidth drops to 12GB/s. After 20 minutes, 10GB/s. Your 5.36 tokens/sec becomes 4.1 tokens/sec. Active cooling on cables helps but you’re fighting physics.

Thermal throttling of network cables is a new thing to me…

I admire patience of anyone who runs dense models on unified memory. Personally, I would rather feed an entire programming book or code directory to a sparse model and get an answer in 30 seconds and then use cloud in rare cases it's not enough.

Luckily we're having a record cold winter and your setup can double as a personal space heater.

Call for pricing.

Right, not to "defend" the paper's claims, but it seems to be more like tuning how the leaky bucket leaks, using lossy compression to try to preserve some measure of coherency? Seems to turn on the fixed size summary.

So, passwordless sudo, got it.

I mean that's fine for people who can remember what they are holding, but not all of us can do that.

1000x this. Hosts are a minority. The vast majority of guests not only don't host, they are not good at showing appreciation.

Low key this feels why so much of our social life gets productized/monetized.

"data-driven agile"™

Isn't that what Project Corsa is supposed to solve?

Project Corsa is a rewrite of the TypeScript compiler in Go. I don't think that's what's being asked for.