llm

Minimal AI coding agent (~1,000 lines of Python) inspired by Claude Code. Works with any LLM. Think NanoGPT for coding agents. Formerly NanoCoder.

A curation of awesome tools, documents and projects about LLM Security.

Advanced LLM-powered brute-force tool combining AI intelligence with automated login attacks

A high-performance inference engine for AI models

LLM(😽)

【Zotero AI 管家】调用大模型，自动精读论文库里的论文，总结为Zotero笔记。支持主流大模型平台！您只需像往常一样把文献丢进 Zotero， 管家会自动帮您精读论文，将文章揉碎了总结为笔记，让您“十分钟完全了解”这篇论文！

Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.

Optimized Agentic and LLM Bulk Processing Over Your Data

Trench — Open-Source Analytics Infrastructure. A single production-ready Docker image built on ClickHouse, Kafka, and Node.js for tracking events. Easily build product analytics dashboards, LLM RAGs, observability platforms, or any other analytics product.

The open-source React.js Autonomous LLM Agent

:metal: TT-NN operator library, and TT-Metalium low level kernel programming model.

《构筑大语言模型应用：应用开发与架构设计》一本关于 LLM 在真实世界应用的开源电子书，介绍了大语言模型的基础知识和应用，以及如何构建自己的模型。其中包括Prompt的编写、开发和管理，探索最好的大语言模型能带来什么，以及LLM应用开发的模式和架构设计。

Waku Waku! Waku Agent is a local-first AI agent harness you actually own, including loop, memory, eval, all in code built to stay legible as it grows.

Agent-R1: Training Powerful LLM Agents with End-to-End Reinforcement Learning

Make your own story. User-friendly software for LLM roleplaying

The coding agent that answers to you, your model, your machine, your rules.

A fast and lightweight framework for creating decentralized agents with ease.

Open-source multi-agent AI desktop client — build and command your AI agent team through conversation. A commander LLM dispatches sub-agents in parallel or in series; agents self-evolve via reflection and skill crystallization. Local-first, BYO LLM keys (Claude · OpenAI · Gemini · DeepSeek · Kimi · GLM · Qwen). macOS / Windows / Linux.

Tool for generating high quality Synthetic datasets

一款包含了 Prompt管理，Skill管理，Agent管理的一站式AI工具箱，助你高效管理提示词，一键分发skills ，一站式管理Agent资产，并实现云同步，备份，版本管理 | An all-in-one AI toolbox for prompt, agent, and skills management. Reuse prompts, distribute skills with one click, manage agent assets, and support cloud sync, backup, and version control

A collection of AI Agents papers (Updated biweekly)

playwright for windows computer use

ROSA 🤖 is an AI Agent designed to interact with ROS1- and ROS2-based robotics systems using natural language queries. ROSA helps robot developers inspect, diagnose, understand, and operate robots.

🔥 Real-time NVIDIA GPU dashboard

This repository provides an advanced Retrieval-Augmented Generation (RAG) solution for complex question answering. It uses sophisticated graph based algorithm to handle the tasks.

Real-time visualization of Claude Code agent orchestration — see your agents think, branch, and coordinate as they work.

Model compression toolkit engineered for enhanced usability, comprehensiveness, and efficiency.

Unified multimodal backend for AI data apps

A curated list of awesome resources, tools, and other shiny things for LLM prompt engineering.