language-model

Self-contained Machine Learning and Natural Language Processing library in Go

简繁扩展词库/声调编码/最全声调标注工具链/万象更新工具链/Rime语法模型：LMDG - Language, Model, Dictionary, Grammar。没错这里是万象拼音的“罗马帝国”!

The official implementation of RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrieval

中文对话0.2B小模型（ChatLM-Chinese-0.2B），开源所有数据集来源、数据清洗、tokenizer训练、模型预训练、SFT指令微调、RLHF优化等流程的全部代码。支持下游任务sft微调，给出三元组信息抽取微调示例。

Create architecture diagrams from code automatically using large language models (LLMs).

Macaw-LLM: Multi-Modal Language Modeling with Image, Video, Audio, and Text Integration

INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model

[EMNLP 2025 Oral] MemoryOS is designed to provide a memory operating system for personalized AI agents.

Tiny Model, Big Logic: Diversity-Driven Optimization Elicits Large-Model Reasoning Ability in VibeThinker-1.5B

A curriculum for learning about foundation models, from scratch to the frontier

Pre-trained Chinese ELECTRA（中文ELECTRA预训练模型）

日本語LLMまとめ - Overview of Japanese LLMs

Korean BERT pre-trained cased (KoBERT)

🛸 Use pretrained transformers like BERT, XLNet and GPT-2 in spaCy

Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization

An Open-sourced Knowledgable Large Language Model Framework.

Cramming the training of a (BERT-type) language model into limited compute.

The implementation of "Prismer: A Vision-Language Model with Multi-Task Experts".

Transformers4Rec is a flexible and efficient library for sequential and session-based recommendation and works with PyTorch.

List of language agents based on paper "Cognitive Architectures for Language Agents"

A voice chat app

💁 Awesome Treasure of Transformers Models for Natural Language processing contains papers, videos, blogs, official repo along with colab Notebooks. 🛫☑️

A collection of open-source dataset to train instruction-following LLMs (ChatGPT,LLaMA,Alpaca)

A curated list of NLP resources focused on Transformer networks, attention mechanism, GPT, BERT, ChatGPT, LLMs, and transfer learning.

[NeurIPS 2023] LLM-Pruner: On the Structural Pruning of Large Language Models. Support Llama-3/3.1, Llama-2, LLaMA, BLOOM, Vicuna, Baichuan, TinyLlama, etc.

ToRA is a series of Tool-integrated Reasoning LLM Agents designed to solve challenging mathematical reasoning problems by interacting with tools [ICLR'24].

Z80-μLM is a 2-bit quantized language model small enough to run on an 8-bit Z80 processor. Train conversational models in Python, export them as CP/M .COM binaries, and chat with your vintage computer.

LangSmith Client SDK Implementations

A Python wrapper for Kaldi

[support ollama/other model]【兼容ollama和其他模型】将任何具有OpenAI API调用方法的模型集成到PotPlayer中。它使你在观看视频时能够实时翻译字幕，从而打破语言障碍，提升你的观看体验。 This real-time subtitle translation plugin integrates OpenAI's ChatGPT API (or any model with the same API calling method) into PotPlayer. It enables you to translate subtitles on-the-fly while watching videos.