falcon

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

Embrace the APIs of the future. Hug aims to make developing APIs as simple as possible, but no simpler.

A familiar HTTP Service Framework for Python.

A high-performance web server for Ruby, supporting HTTP/1, HTTP/2 and TLS.

LLM Finetuning with peft

A friendly library for parsing HTTP request arguments, with built-in support for popular web frameworks, including Flask, Django, Bottle, Tornado, Pyramid, webapp2, Falcon, and aiohttp.

🦙 Integrating LLMs into structured NLP pipelines

The simplest way to serve AI/ML models in production

🤖 A PyTorch library of curated Transformer models and their composable components

Toolkit for fine-tuning, ablating and unit-testing open-source LLMs.

The CrowdStrike Falcon SDK for Python

FastOpenAPI is a library for generating and integrating OpenAPI schemas using Pydantic v2 and various frameworks (AioHttp, Django, Falcon, Flask, Quart, Sanic, Starlette, Tornado).