bert

Large-scale Pre-training Corpus for Chinese 100G 中文预训练语料

从 NLP 到 LLM 的算法全栈教程，在线阅读地址：https://datawhalechina.github.io/base-llm/

SPLADE: sparse neural search (SIGIR21, SIGIR22)

building a chinese dialogue system based on the newest version of rasa(基于最新版本rasa搭建的对话系统)

TextGen: Implementation of Text Generation models, include LLaMA, BLOOM, GPT2, BART, T5, SongNet and so on. 文本生成模型，实现了包括LLaMA，ChatGLM，BLOOM，GPT2，Seq2Seq，BART，T5，UDA等模型的训练和预测，开箱即用。

Official implementation of the papers "GECToR – Grammatical Error Correction: Tag, Not Rewrite" (BEA-20) and "Text Simplification by Tagging" (BEA-21)

Transformer models from BERT to GPT-4, environments from Hugging Face to OpenAI. Fine-tuning, training, and prompt engineering examples. A bonus section with ChatGPT, GPT-3.5-turbo, GPT-4, and DALL-E including jump starting GPT-4, speech-to-text, text-to-speech, text to image generation with DALL-E, Google Cloud AI,HuggingGPT, and more

🤖 A PyTorch library of curated Transformer models and their composable components

Portuguese pre-trained BERT models

Github repo with tutorials to fine tune transformers for diff NLP tasks

PhoBERT: Pre-trained language models for Vietnamese (EMNLP-2020 Findings)

多标签文本分类，多标签分类，文本分类, multi-label, classifier, text classification, BERT, seq2seq，attention, multi-label-classification

Fuzzy string matching, grouping, and evaluation.

KG-BERT: BERT for Knowledge Graph Completion

PatrickStar enables Larger, Faster, Greener Pretrained Models for NLP and democratizes AI for everyone.

Pytorch implementation of JointBERT: "BERT for Joint Intent Classification and Slot Filling"

The prime repository for state-of-the-art Multilingual Question Answering research and development.

LLM-PowerHouse: Unleash LLMs' potential through curated tutorials, best practices, and ready-to-use code for custom training and inferencing.

Simple implementation of OpenAI CLIP model in PyTorch.

Revisiting Pre-trained Models for Chinese Natural Language Processing (MacBERT)

Awesome-LLM-Eval: a curated list of tools, datasets/benchmark, demos, leaderboard, papers, docs and models, mainly for Evaluation on LLMs. 一个由工具、基准/数据、演示、排行榜和大模型等组成的精选列表，主要面向基础大模型评测，旨在探求生成式AI的技术边界.

The first-ever vast natural language processing benchmark for Indonesian Language. We provide multiple downstream tasks, pre-trained IndoBERT models, and a starter code! (AACL-IJCNLP 2020)

BERTweet: A pre-trained language model for English Tweets (EMNLP-2020)

An implementation of the BERT model and its related downstream tasks based on the PyTorch framework. @跟我学机器学习

📖 Korean NLU Benchmark

Span-level grounding verification for RAG, code, and tool-grounded AI outputs.

NLP Paper

tensorflow를 사용하여 텍스트 전처리부터, Topic Models, BERT, GPT, LLM과 같은 최신 모델의 다운스트림 태스크들을 정리한 Deep Learning NLP 저장소입니다.

Natural Language Processing with Transformers 中译本，最权威Transformers教程

Turkish BERT/DistilBERT, ELECTRA, ConvBERT and T5 models