Next up....WebGPU chatbot? ChatGPT style chat with your own GPU in the browser? | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		aussieguy1234 on July 18, 2023 \| parent \| context \| favorite \| on: Stable Diffusion WebGPU demo Next up....WebGPU chatbot? ChatGPT style chat with your own GPU in the browser?

brucethemoose2 on July 18, 2023 | [–]

Also already done... With some limitations.

LLMs are especially tricky for WebGPU because the good models are so RAM/VRAM heavy.

moffkalast on July 18, 2023 | [–]

https://webllm.mlc.ai/

Already done.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact