MoonshotAI/MoBA

MoBA: Mixture of Block Attention for Long-Context LLMs

↗ Open on GitHub

Stars

2,174

Forks

158

Language

Python

License

MIT

Last push

1 year ago

Python llm transformer pytorch flash-attention llm-serving llm-training moe

No related intel yet

This repo has not appeared in any of the sources the radar tracks. The collector runs on a schedule — check back once it covers this repo.