llm

WebAssembly binding for llama.cpp - Enabling on-browser LLM inference

A Ruby Implementation of the Model Context Protocol

Instant SECURE Full Stack Apps and AI Agents

Real-time two-way speech translation for bilingual meetings — auto-detects the spoken language and translates both directions, cloud or fully offline on-device. Desktop (Windows · macOS · Linux) + browser extension (Chrome · Edge) for Zoom, Meet, Teams & any app.

Semi-Structured Agentic Framework. Workflows build themselves as agents discover what needs to be done, not what you predicted upfront.

AI-powered code assistant for Vim. OpenAI and ChatGPT plugin for Vim and Neovim.

Inkdown is a WYSIWYG editor and an LLM dialogue tool, fully compatible with GitHub Flavored Markdown Spec.

600 行 TypeScript 写成的超级迷你版 pi，让你轻松从 0 写出属于你的 pi-agent

A minimal LLM chat app that runs entirely in your browser

A practical lab for building, testing, and evaluating apps with Apple's Foundation Models framework.

明医 (MING)：中文医疗问诊大模型

LLM-compiled knowledge bases for any AI agent. Parallel multi-agent research, thesis-driven investigation, source ingestion, wiki compilation, querying, and artifact generation.

Trace-native CI/CD for AI agents — production failures become regression tests that block the PR. Auto-detect, cluster, freeze into hermetic cases, replay in CI for $0.

🌎💎 개발자들의 첫 번째 북마크

Agentic SOC Platform: A powerful, flexible, open-source, and agent-centric automated security operations platform (AI SOC)

Unifying 3D Mesh Generation with Language Models

A-MEM: Agentic Memory for LLM Agents

A set of tools that gives agents powerful capabilities.

LangChain powered shell command generator and runner CLI

Simple go utility to download HuggingFace Models and Datasets

AI辅助长篇小说创作，卡片式创作，支持基于 JSON Schema的结构化 AI 生成与上下文引用，可扩展性强。

Evaluate and improve models and agents using environments

Streamlines and simplifies prompt design for both developers and non-technical users with a low code approach.

A desktop MCP client designed as a tool unitary utility integration, accelerating AI adoption through the Model Context Protocol (MCP) and enabling cross-vendor LLM API orchestration.

Train speculative decoding models effortlessly and port them smoothly to SGLang serving.

[NeurIPS 2023] LLM-Pruner: On the Structural Pruning of Large Language Models. Support Llama-3/3.1, Llama-2, LLaMA, BLOOM, Vicuna, Baichuan, TinyLlama, etc.

FP16xINT4 LLM inference kernel that can achieve near-ideal ~4x speedups up to medium batchsizes of 16-32 tokens.

An open-source, PyTorch-like runtime for dynamic multi-agent and multi-session workflows.

NativeMind: Your fully private, open-source, on-device AI assistant

Open-source, self-hosted enterprise & site search server built on OpenSearch. Crawls web / file / DB / cloud sources, 20+ languages, REST API, and AI/RAG & semantic search. Apache-2.0.