nlp

[EMNLP 2022] An Open Toolkit for Knowledge Graph Extraction and Construction

General technology for enabling AI capabilities w/ LLMs and MLLMs

LLM training code for Databricks foundation models

Natural language detection

This project reproduces the book Dive Into Deep Learning (https://d2l.ai/), adapting the code from MXNet into PyTorch.

Data Science Roadmap from A to Z

MNBVC(Massive Never-ending BT Vast Chinese corpus)超大规模中文语料集。对标chatGPT训练的40T数据。MNBVC数据集不但包括主流文化，也包括各个小众文化甚至火星文的数据。MNBVC数据集包括新闻、作文、小说、书籍、杂志、论文、台词、帖子、wiki、古诗、歌词、商品介绍、笑话、糗事、聊天记录等一切形式的纯文本中文数据。

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

AdalFlow: The library to build & auto-optimize LLM applications.

ChatGPT资料汇总学习，持续更新......

The Hugging Face course on Transformers

State of the Art Natural Language Processing

Language model tokenization at GB/s

中文 NLP 预处理、解析工具包，准确、高效、易用 A Chinese NLP Preprocessing & Parsing Package www.jionlp.com

Superfast AI decision making and intelligent processing of multi-modal data.

中文nlp解决方案(大模型、数据、模型、训练、推理)

Datawhale成员整理的面经，内容包括机器学习，CV，NLP，推荐，开发等，欢迎大家star

Curated tutorials and resources for Large Language Models, Text2SQL, Text2DSL、Text2API、Text2Vis and more.

Module for automatic summarization of text documents and HTML pages.

[EMNLP 2021] SimCSE: Simple Contrastive Learning of Sentence Embeddings https://arxiv.org/abs/2104.08821

深度学习入门课、资深课、特色课、学术案例、产业实践案例、深度学习知识百科及面试题库The course, case and knowledge of Deep Learning and AI

快速上手AI理论及应用实战：基础知识、Transformer、NLP、ML、DL、竞赛。含大量注释及数据集，力求每一位能看懂并复现。

🛠 All-in-one web-based IDE specialized for machine learning and data science.

TextAttack 🐙 is a Python framework for adversarial attacks, data augmentation, and model training in NLP https://textattack.readthedocs.io/en/master/

[TMLR] A curated list of language modeling researches for code (and other software engineering activities), plus related datasets.

we want to create a repo to illustrate usage of transformers in chinese

A Repo For Document AI

深度学习100例、深度学习DL、图片分类、目标识别、目标检测、自然语言处理nlp、文本分类、TensorFlow、PyTorch

textlint is the pluggable linter for natural language text.

Must-read Papers on LLM Agents.