language-model

The only fully local production-grade Super SDK that provides a simple, unified, and powerful interface for calling more than 200+ LLMs.

NLP Paper

Phi2-Chinese-0.2B 从0开始训练自己的Phi2中文小模型，支持接入langchain加载本地知识库做检索增强生成RAG。Training your own Phi2 small chat model from scratch.

Connectionist Temporal Classification (CTC) decoder with dictionary and language model.

CL-bench: A Benchmark for Context Learning

Language model search engine built on a vector database and an anything key/value store.

Interactive Composition Explorer: a debugger for compositional language model programs

A simple example implementation of the VoiceRAG pattern to power interactive voice generative AI experiences using RAG with Azure AI Search and Azure OpenAI's gpt-4o-realtime-preview model.

Implementation of ChatGPT RLHF (Reinforcement Learning with Human Feedback) on any generation model in huggingface's transformer (blommz-176B/bloom/gpt/bart/T5/MetaICL)

ChatGPT PROMPTs Splitter. Tool for safely process chunks of up to 15,000 characters per request

Korean GPT-2 pretrained cased (KoGPT2)

DialogStudio: Towards Richest and Most Diverse Unified Dataset Collection and Instruction-Aware Models for Conversational AI

[ICLR 2024] DNABERT-2: Efficient Foundation Model and Benchmark for Multi-Species Genome

A simple Java library for interacting with Ollama server.