Research seems to suggest we need exponential training data volume increases to ... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		smartician on June 14, 2024 \| parent \| context \| favorite \| on: Ask HN: When will we hit a limit on LLM performanc... Research seems to suggest we need exponential training data volume increases to see meaningful performance gains: https://arxiv.org/abs/2404.04125 Personally I think we've already hit a ceiling.

p1esk on June 15, 2024 [–]

We have pretty much infinite training data available on YouTube. We can scale by many orders of magnitude before we run out of data. Why do you think we hit a ceiling?

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact