llm

Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization

The easiest way to use Ollama in .NET

A modular and comprehensive solution to deploy a Multi-LLM and Multi-RAG powered chatbot (Amazon Bedrock, Anthropic, HuggingFace, OpenAI, Meta, AI21, Cohere, Mistral) using AWS CDK on AWS

llama.go is like llama.cpp in pure Golang!

Fine-tune LLMs on your Mac with Apple Silicon. SFT, DPO, GRPO, Vision, TTS, STT, Embedding, and OCR fine-tuning — natively on MLX. Unsloth-compatible API.

🦙 Integrating LLMs into structured NLP pipelines

Universal AI context generator. Saves thousands of tokens per conversation in Claude Code, Cursor, Copilot, Codex, and more.

💃 Dance with Intelligence in Your Code. Minuet offers code completion as-you-type from popular LLMs including OpenAI, Gemini, Claude, Ollama, Llama.cpp, Codestral, and more.

Token-efficient MCP adapter for Pi coding agent

On-device LLM execution in React Native with Vercel AI SDK compatibility

Examples of using E2B

OWASP Top 10 for Large Language Model Apps (Part of the GenAI Security Project)

A curated collection of top-tier penetration testing tools and productivity utilities across multiple domains. Join us to explore, contribute, and enhance your hacking toolkit!

An open-source, code-first Typescript toolkit for building, evaluating, and deploying sophisticated AI agents with flexibility and control.

The 𝗣𝗼𝘄𝗲𝗿𝗳𝘂𝗹 Conversational AI JavaScript Library 💬 — UI for any LLM, supporting LangChain / HuggingFace / Vercel AI, and more 🧡 React, Next.js, and plain JavaScript ⭐️

Application implementation with business use cases for safely utilizing generative AI in business operations

The community's most comprehensive, continuously-updated index of research on Large Language Models for software vulnerability detection — papers across function-level, repository-level, agentic, and smart-contract detection, plus datasets, benchmarks, and surveys.

A Model Context Protocol (MCP) server that enables secure interaction with MySQL databases

Unified KV Cache Compression Methods for Auto-Regressive Models

A Utility CLI for AI Coding Agents

LLMs for your CLI

Parallax is a distributed model serving framework that lets you build your own AI cluster anywhere

Autonomous Agents (LLMs) research papers. Updated Daily.

The agent framework where every run is durable, replayable, and resumable by default.

NeuroSploit is an advanced, AI-powered penetration testing framework designed to automate and augment various aspects of offensive security operations.

AI Vibe Coding Agent of TS backend server, enhanced by compiler skills, generating 100% working code

📎 Clippy, now with some AI

Webchat to API

Infrastructure that's powering E2B Cloud.

Lightweight library for scraping web-sites with LLMs