transformer

Safe RLHF: Constrained Value Alignment via Safe Reinforcement Learning from Human Feedback

PaddleSlim is an open-source library for deep model compression and architecture search.

A Unified Semi-Supervised Learning Codebase (NeurIPS'22)

Tiny Model, Big Logic: Diversity-Driven Optimization Elicits Large-Model Reasoning Ability in VibeThinker-1.5B

a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc) on CPU and GPU.

[ICLR'23 Spotlight & ECCV'24 & IJCV'24] MapTR: Structured Modeling and Learning for Online Vectorized HD Map Construction

"Retinexformer: One-stage Retinex-based Transformer for Low-light Image Enhancement" (ICCV 2023 Top-10 Cited 🏆) & (NTIRE 2024 Runner-Up 🏆) & (NTIRE 2025 Winner 🏆) & (NTIRE 2026 Winner 🏆)

A paper list of some recent Transformer-based CV works.

A group of notebooks and other files which can help you learn AI from scratch.

This repository is the official implementation of Disentangling Writer and Character Styles for Handwriting Generation (CVPR 2023)

Free Offline OCR 离线的中文文本检测+识别SDK

[TPAMI'23] Unifying Flow, Stereo and Depth Estimation

Parallax is a distributed model serving framework that lets you build your own AI cluster anywhere

PoolFormer: MetaFormer Is Actually What You Need for Vision (CVPR 2022 Oral)

Research of DeepSeek Engram Architecture based on Qwen-3 and Stable Diffusion series.

Attention is all you need implementation

Transformers4Rec is a flexible and efficient library for sequential and session-based recommendation and works with PyTorch.

🎓 系统性大语言模型构建课程｜🛠️ 覆盖预训练数据工程、Tokenizer、Transformer、MoE、GPU 编程 (CUDA/Triton)、分布式训练、Scaling Laws、推理优化及对齐 (SFT/RLHF/GRPO)｜🚀 6 个渐进式作业 + 代码驱动，建立 LLM 全栈认知体系

A python package to run contextualized topic modeling. CTMs combine contextualized embeddings (e.g., BERT) with topic models to get coherent topics. Published at EACL and ACL 2021 (Bianchi et al.).

Pocket-Sized Multimodal AI for content understanding and generation across multilingual texts, images, and 🔜 video, up to 5x faster than OpenAI CLIP and LLaVA 🖼️ & 🖋️

Bringing together outstanding artificial intelligence (AI) open source projects from around the world.

Sequence-to-sequence framework with a focus on Neural Machine Translation based on PyTorch

💁 Awesome Treasure of Transformers Models for Natural Language processing contains papers, videos, blogs, official repo along with colab Notebooks. 🛫☑️

A Deep Learning library for EEG Tasks (Signals) Classification, based on TensorFlow.

[NeurIPS 2020] Official code for the paper "DeepSVG: A Hierarchical Generative Network for Vector Graphics Animation". Includes a PyTorch library for deep learning with SVG data.

A curated list of NLP resources focused on Transformer networks, attention mechanism, GPT, BERT, ChatGPT, LLMs, and transfer learning.

OpenSTL: A Comprehensive Benchmark of Spatio-Temporal Predictive Learning

Neural question generation using transformers

[Unofficial] PyTorch implementation of "Conformer: Convolution-augmented Transformer for Speech Recognition" (INTERSPEECH 2020)

SwissArmyTransformer is a flexible and powerful library to develop your own Transformer variants.