Not sure what you mean: https://aws.amazon.com/ec2/graviton/ Not to speak of man... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		adam_arthur on Oct 3, 2024 \| parent \| context \| favorite \| on: Serving 70B-scale LLMs efficiently on low-resource... Not sure what you mean: https://aws.amazon.com/ec2/graviton/ Not to speak of managed cloud services that run on ARM under-the-hood/behind the scenes. Of course ARM isn't inherently cheaper, AMD+Intel could cut prices/margins big and probably be competitive on $/perf

lxgr on Oct 4, 2024 [–]

That's what I mean: ARM was initially attractive in the low-power/low-performance market, then it scaled up to higher and higher power cores (while still staying power efficient), which in turn attracted datacenter customers.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact