genai

🚀 Awesome System for Machine Learning ⚡️ AI System Papers and Industry Practice. ⚡️ System for Machine Learning, LLM (Large Language Model), GenAI (Generative AI). 🍻 OSDI, NSDI, SIGCOMM, SoCC, MLSys, etc. 🗃️ Llama3, Mistral, etc. 🧑‍💻 Video Tutorials.

Optimizing inference proxy for LLMs

[ICLR2025 Spotlight] SVDQuant: Absorbing Outliers by Low-Rank Components for 4-Bit Diffusion Models

Universal memory layer for AI Agents. It provides scalable, extensible, and interoperable memory storage and retrieval to streamline AI agent state management for next-generation autonomous systems.

ComfyUI Plugin of Nunchaku

Open source platform for AI Engineering: OpenTelemetry-native LLM Observability, GPU Monitoring, Guardrails, Evaluations, Prompt Management, Vault, Playground. 🚀💻 Integrates with 50+ LLM Providers, VectorDBs, Agent Frameworks and GPUs.

Comprehensive resources on Generative AI, including a detailed roadmap, projects, use cases, interview preparation, and coding preparation.

Build, run and scale AI agents like API and microservices

China Unicom's Yuanjing Wanwu Agent Platform is an enterprise-grade, multi-tenant AI agent development platform. It helps users build applications such as intelligent agents, workflows, and rag, and also supports model management. The platform features a developer-friendly license, and we welcome all developers to build upon the platform.

Build reliable Gen AI solutions without overhead 🍕

GenAI Processors is a lightweight Python library that enables efficient, parallel content processing.

The open-source RAG platform: built-in citations, deep research, 22+ file formats, partitions, MCP server, and more.

Let us democratise high-resolution generation! (CVPR 2024)

Witsy: desktop AI assistant / universal MCP client

一款简单易用和高性能的AI部署框架 | An Easy-to-Use and High-Performance AI Deployment Framework

An open-source, code-first Java toolkit for building, evaluating, and deploying sophisticated AI agents with flexibility and control.

LLPhant - A comprehensive PHP Generative AI Framework using OpenAI GPT 4. Inspired by Langchain

This repository provides an advanced Retrieval-Augmented Generation (RAG) solution for complex question answering. It uses sophisticated graph based algorithm to handle the tasks.

Unified multimodal backend for AI data apps

A toolkit to create optimal Production-readyRetrieval Augmented Generation(RAG) setup for your data

Build AI agents for your PC

An open-source project for Windows developers to learn how to add AI with local models and APIs to Windows apps.

Benchmark LLMs by fighting in Street Fighter 3! The new way to evaluate the quality of an LLM

A modular and comprehensive solution to deploy a Multi-LLM and Multi-RAG powered chatbot (Amazon Bedrock, Anthropic, HuggingFace, OpenAI, Meta, AI21, Cohere, Mistral) using AWS CDK on AWS

An open-source, code-first Typescript toolkit for building, evaluating, and deploying sophisticated AI agents with flexibility and control.

Jlama is a modern LLM inference engine for Java

Neo4j GraphRAG for Python

Neural Network Compression Framework for enhanced OpenVINO™ inference

A set of tools that gives agents powerful capabilities.

Notebooks & Example Apps for Search, Observability, and Security with Elasticsearch