Cost is one aspect, but what about ingest time? You’re adding significant proces... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		davedx on Sept 20, 2024 \| parent \| context \| favorite \| on: Contextual Retrieval Cost is one aspect, but what about ingest time? You’re adding significant processing time to your pipeline with this method right?

simonw on Sept 20, 2024 [–]

I expect most implementations of RAG don't mind this too much - if you're dealing with only a few hundred more pages of documents a day the ingestion time from using fancy tricks like this is going to be measured in minutes.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact