llm

🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support

A list of open-source AI projects you can use to generate income easily.

Local-first privacy guard: anonymize your documents before sharing with LLMs.

A highly optimized LLM inference acceleration engine for Llama and its variants.

Deep research agent to help you find the best GitHub repositories 🕵️!

A production-ready template to kickstart your Generative AI projects with structure and scalability in mind.

盯盘侠 PanWatch · 自托管 AI 盯盘助手，集成 TradingAgents 多 Agent 投资决策 | A股/港股/美股实时监控、持仓管理、智能分析、全渠道推送

OpenEverest is an open-source platform for automated database provisioning and management. It supports multiple database technologies and can be hosted on any Kubernetes infrastructure, in the cloud or on-premises.

开源的每日 arXiv / OpenReview 论文推荐与 AI 阅读平台，支持 GitHub Actions 自动更新、GitHub Pages 部署与论文问答。

A high-performance ML model serving framework, offers dynamic batching and CPU/GPU pipelines to fully exploit your compute machine

RAG Time: A 5-week Learning Journey to Mastering RAG

【新增智能体模式】安卓端全场景GPT助手，可用音量键唤起并进行语音交流，支持联网、拍照、模板、附件解析、智能体模式等 | GPT assistant for Android, activated via volume keys for voice interaction, supporting features such as networking, taking photos, templates, parsing PDF and Office documents, and agent mode.

🚀 Run Codex Mobile Anywhere: Linux, Windows, or Termux on Android 🚀

LAYRA—an enterprise-ready, out-of-the-box solution—unlocks next-generation intelligent systems powered by visual RAG and limitless visual multi-step agent workflow orchestration.

Autonomous AI pentesting engine across web, cloud, identity, CI/CD, IaC, databases, Active Directory, Kubernetes, IoT firmware and AI/LLM endpoints (OWASP LLM Top 10). Real exploits with proof for every finding. Privacy gateway: the LLM never sees your real IPs, hosts or creds; nothing leaves your perimeter.

Open deep learning compiler stack for Kendryte AI accelerators ✨

Token efficient Claude Code full Python rebuild. AI Coding Agent in 310K LoC Python.

🔬🦞 A self-evolving AI research colleague for scientists. 285 skills, zero hallucination, persistent memory.

Expose Gemini CLI endpoints as OpenAI API with Cloudflare Workers

A talking LLM that runs on your own computer without needing the internet.

A local sandbox for your AI agents

🤖 A PyTorch library of curated Transformer models and their composable components

LLM notes, including model inference, transformer model structure, and llm framework code analysis notes.

AI workflow automation plugin for intelligent code generation with Claude/Codex

AgentChat 是一个基于 LLM 的智能体交流平台，内置默认 Agent 并支持用户自定义 Agent。通过多轮对话和任务协作，Agent 可以理解并协助完成复杂任务。项目集成 LangChain、Function Call、MCP 协议、RAG、Memory、HITL、Skill、Milvus 和 ElasticSearch 等技术，实现高效的知识检索与工具调用，使用 FastAPI 构建高性能后端服务。

The ripgrep of AI context: a zero-dependency C++23 CLI + MCP server giving coding agents a ranked, deterministic map of any repo, blast radius, tests-to-run and quality deltas. Signatures at 80% fewer bytes than bodies; ~5% of a grep-and-read pass's tokens.

Code2Prompt is a powerful command-line tool that simplifies the process of providing context to Large Language Models (LLMs) by generating a comprehensive Markdown file containing the content of your codebase. ⭐ If you find Code2Prompt useful, consider giving us a star on GitHub! It helps us reach more developers and improve the tool. ⭐

A 10-week, 30-minutes-a-day roadmap for LLM inference serving and optimization. vLLM, SGLang, quantization, speculative decoding, benchmarking.

[ICLR 2025] Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing. Your efficient and high-quality synthetic data generation pipeline!

LSP server leveraging LLMs for code completion (and more?)