Not if you're serving tens of thousands of users at the same time. | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		twothreeone on Aug 28, 2024 \| parent \| context \| favorite \| on: Cerebras launches inference for Llama 3.1; benchma... Not if you're serving tens of thousands of users at the same time.

cma on Aug 28, 2024 [–]

Still tiny at 100,000.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact