llama

Vim plugin for LLM-assisted code/text completion

Inference Llama 2 in one file of pure 🔥

Lightweight inference library for ONNX files, written in C++. It can run Stable Diffusion XL 1.0 on a RPI Zero 2 (or in 298MB of RAM) but also Mistral 7B on desktops and servers. ARM, x86, WASM, RISC-V supported. Accelerated by XNNPACK. Python, C# and JS(WASM) bindings available.

llama and other large language models on iOS and MacOS offline using GGML library.

中文羊驼大模型三期项目 (Chinese Llama-3 LLMs) developed from Meta Llama 3

Autoregressive Model Beats Diffusion: 🦙 Llama for Scalable Image Generation

The leading open-source AI copilot for JetBrains. Connect to any model in any environment, and customize your coding experience in any way you like.

[ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling

Run LLMs on AMD Ryzen™ AI NPUs in minutes; purpose-built and deeply optimized for the AMD NPUs.

Synthesizing Graphics Programs for Scientific Figures and Sketches with TikZ.

A modern and easy-to-use client for Ollama

🚀🚀🚀 A collection of some awesome public YOLO object detection series projects and the related object detection datasets.

The React library for LLMs

A curated list of awesome LLM and AI Agent Skills, resources and tools for customising AI Agent workflows - that works with Claude Code, Codex, Gemini CLI and your custom AI Agents

Create characters in Unity with LLMs!

:metal: TT-NN operator library, and TT-Metalium low level kernel programming model.

Make your own story. User-friendly software for LLM roleplaying

Safe RLHF: Constrained Value Alignment via Safe Reinforcement Learning from Human Feedback

`llm-chain` is a powerful rust crate for building chains in large language models allowing you to summarise text and complete complex tasks

Fast Multimodal LLM on Mobile Devices

Lag-Llama: Towards Foundation Models for Probabilistic Time Series Forecasting

KoAlpaca: 한국어 명령어를 이해하는 오픈소스 언어모델 (KoAlpaca: An open-source language model to understand Korean instructions)

Chat with your favourite LLaMA models in a native macOS app

[ACL 2024 🔥] Video-ChatGPT is a video conversation model capable of generating meaningful conversation about videos. It combines the capabilities of LLMs with a pretrained visual encoder adapted for spatiotemporal video representation. We also introduce a rigorous 'Quantitative Evaluation Benchmarking' for video-based conversational models.

VS Code extension for LLM-assisted code/text completion

Run local LLMs like llama, deepseek-distill, kokoro and more inside your browser

Interface for OuteTTS models.

🍦 Speech-AI-Forge is a project developed around TTS generation model, implementing an API Server and a Gradio-based WebUI.

Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization

The easiest way to use Ollama in .NET