llama

llama.go is like llama.cpp in pure Golang!

🦙 Integrating LLMs into structured NLP pipelines

An Open-sourced Knowledgable Large Language Model Framework.

Parallax is a distributed model serving framework that lets you build your own AI cluster anywhere

📎 Clippy, now with some AI

An elegent pytorch implement of transformers

RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.

Jlama is a modern LLM inference engine for Java

The simplest way to run Alpaca (and other LLaMA-based local LLMs) on your own computer

Help your LLMs online

Hexabot v3 is an AI workflow automation platform, combining workflows, actions, agents, and conversational channels in one runtime.

WebAssembly binding for llama.cpp - Enabling on-browser LLM inference

A set of tools that gives agents powerful capabilities.

A collection of open-source dataset to train instruction-following LLMs (ChatGPT,LLaMA,Alpaca)

A curated list of NLP resources focused on Transformer networks, attention mechanism, GPT, BERT, ChatGPT, LLMs, and transfer learning.

[NeurIPS 2023] LLM-Pruner: On the Structural Pruning of Large Language Models. Support Llama-3/3.1, Llama-2, LLaMA, BLOOM, Vicuna, Baichuan, TinyLlama, etc.

Compare the performance of different LLM that can be deployed locally on consumer hardware. Run yourself with Colab WebUI.

Chat with AI large language models running natively in your browser. Enjoy private, server-free, seamless AI conversations.

[ECCV 2024 Best Paper Candidate & TPAMI 2025] PointLLM: Empowering Large Language Models to Understand Point Clouds

TypeScript AI AI Function Calling Framework enhanced by compiler skills.

An LLM-powered repository agent designed to assist developers and teams in generating documentation and understanding repositories quickly.

React Native binding of llama.cpp

从 NLP 到 LLM 的算法全栈教程，在线阅读地址：https://datawhalechina.github.io/base-llm/

Cotabby is local AI autocomplete for your entire Mac. Open source. On device. Everywhere you type.

⛷️ LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-training (EMNLP 2024)

A Framework of Small-scale Large Multimodal Models

中文法律LLaMA (LLaMA for Chinese legel domain)

Build AI agents from first principles using a local LLM - no frameworks, no cloud APIs, no hidden reasoning.

A complete guide to start and improve your LLM skills in 2026 with little background in the field and stay up-to-date with the latest news and state-of-the-art techniques!

TextGen: Implementation of Text Generation models, include LLaMA, BLOOM, GPT2, BART, T5, SongNet and so on. 文本生成模型，实现了包括LLaMA，ChatGLM，BLOOM，GPT2，Seq2Seq，BART，T5，UDA等模型的训练和预测，开箱即用。