Skip to main content
buildradar
Sign in

therealoliver/Deepdive-llama3-from-scratch

@therealoliver

Achieve the llama3 inference step-by-step, grasp the core concepts, master the process derivation, implement the code.

Stars
629
Forks
53
Language
Jupyter Notebook
License
MIT
Last push
2 years ago
Jupyter Notebookgptlanguage-modeltransformerllmstokenizerllamainferenceattentionattention-mechanismkv-cachermsropemaskllm-configurationmulti-head-attentionpositional-encodingresidualsrms-normrotary-position-encodingswiglu

No related intel yet

This repo has not appeared in any of the sources the radar tracks. The collector runs on a schedule — check back once it covers this repo.