llm

Mac compatible Ollama Voice

T3Code, but in your terminal

On-device meeting capture, dictation, and vault-native knowledge layer for macOS. Nothing leaves your Mac.

LLM powered retrieval engine designed to process a ton of sources to collect a comprehensive list of entities.

MCP Monitoring with eBPF

🔥 A Survey on AI Auto-Research

Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.

A library for easily merging multiple LLM experts, and efficiently train the merged LLM.

Enable any LLM (e.g. Claude) to interactively debug any language for you via MCP and a VS Code Extension

💡 Awesome RAG: A resource of Retrieval-Augmented Generation (RAG) for LLMs, focusing on the development of technology.

A skill for AI agents: search the web with SearXNG, browse with Camofox, bypass protections with CloakBrowser. Anti-hallucination by design. Self-hosted, free, unlimited.

🕵️‍♂️ Library designed for developers eager to explore the potential of Large Language Models (LLMs) and other generative AI through a clean, effective, and Go-idiomatic approach.

[ACL 2024] Progressive LLaMA with Block Expansion.

Pocket-sized AI chatbot built using a RPI Zero 2w / 5

A Model Context Protocol (MCP) server that enables AI agents and LLMs to query and analyze Prometheus metrics through standardized interfaces.

Linux desktop control over MCP — AT-SPI, GNOME Shell, Wayland portals, ydotool

Measure token savings per AI coding agent, optimize context, and share a live local knowledge graph across 16 CLI clients.

🚀Lightweight Large language model automation and Autonomous Language Agents development framework. Build your LLM Agent Application in a pythonic way!

Open source, local, and self-hosted highly optimized language inference server supporting ASR/STT, TTS, and LLM across WebRTC, REST, and WS

RESTai is an AIaaS (AI as a Service) open-source platform. Supports many public and local LLM suported by Ollama/vLLM/etc. Precise embeddings usage, tuning, analytics etc. Built-in image/audio generation with dynamic loading generators. Live chat deployment. Built-in block based graphical language. Prompt versioning and much more...

Open-source AI voice typing for macOS, Windows, and Linux. Press a hotkey, speak naturally, get polished text in any app.

🚀🚀🚀 This repository lists some awesome public CUDA, cuda-python, cuBLAS, cuDNN, CUTLASS, TensorRT, TensorRT-LLM, Triton, TVM, MLIR, PTX and High Performance Computing (HPC) projects.

AI Vim/Neovim code generation plugin (OpenAI, ChatGPT, and more)

Create knowledge graphs with LLMs

This repository contains documentation created to better understand the open project

A simple Java library for interacting with Ollama server.

Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, TensorRT-LLM, and Triton

🌍 AppWorld: A Controllable World of Apps and People for Benchmarking Function Calling and Interactive Coding Agent, ACL'24 Best Resource Paper.

Browser Operator - The AI browser with built in Multi-Agent platform! Open source alternative to ChatGPT Atlas, Perplexity Comet, Dia and Microsoft CoPilot Edge Browser