Skip to main content
buildradar
Sign in

bigscience-workshop/petals

@bigscience-workshop

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

Stars
10,533
Forks
644
Language
Python
License
MIT
Last push
2 years ago
Pythonmachine-learningdeep-learninggptlarge-language-modelsneural-networkstransformerpytorchlanguage-modelsnlpllamachatbotfalconmixtralpretrained-modelsbloomdistributed-systemspipeline-parallelismvolunteer-computingguanacotensor-parallelism

No related intel yet

This repo has not appeared in any of the sources the radar tracks. The collector runs on a schedule — check back once it covers this repo.