Could this work well with distributed solutions like petals? https://github.com/... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		worldsayshi on Aug 4, 2023 \| parent \| context \| favorite \| on: Non-determinism in GPT-4 is caused by Sparse MoE Could this work well with distributed solutions like petals? https://github.com/bigscience-workshop/petals I don't understand how petals can work though. I thought LLMs were typically quite monolithic.

osmarks on Aug 5, 2023 [–]

Petals does a layerwise split I think. You could probably run separate experts on each system. I don't think this sort of tech is very promising so I haven't looked.

Consider applying for YC's Winter 2026 batch! Applications are open till Nov 10
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact