nlp

[ICLR 2025] Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing. Your efficient and high-quality synthetic data generation pipeline!

Python bindings to libpostal for fast international address parsing/normalization

Toolkit for fine-tuning, ablating and unit-testing open-source LLMs.

An Eigen-based, light-weight C++ Interface to Nonlinear Programming Solvers (Ipopt, Snopt)

👑 spaCy building blocks and visualizers for Streamlit apps

Github repo with tutorials to fine tune transformers for diff NLP tasks

🚀 Catalyst is a C# Natural Language Processing library built for speed. Inspired by spaCy's design, it brings pre-trained models, out-of-the box support for training word and document embeddings, and flexible entity recognition models.

A language detection library for PHP. Detects the language from a given text string.

🔥机器学习/深度学习/Python/大模型/多模态/LLM/deeplearning/Python/Algorithm interview/NLP Tutorial

Use late-interaction multi-modal models such as ColPali in just a few lines of code.

We introduced a new model designed for the Code generation task. Its test accuracy on the HumanEval base dataset surpasses that of GPT-4 Turbo (April 2024) and GPT-4o.

🌟 A curated collection of free, high quality AI tools 🤖, APIs 🔗, datasets 📊, and learning resources 📚 covering machine learning 🧠, deep learning 🧩, generative AI 🎨, NLP 💬, and data science 📈. Designed to help developers 👩‍💻, researchers 🔬, and creators ✨ explore and build with AI faster ⚡.

Natural Language Toolkit for Indic Languages aims to provide out of the box support for various NLP tasks that an application developer might need

DeepResearch Bench: A Comprehensive Benchmark for Deep Research Agents

The online version is temporarily unavailable because we cannot afford the key. You can clone and run it locally. Note: we set defaul openai key. If keys exceed plan and are invalid, please tell us. The response speed depends on openai. ( sometimes, the official is too crowded and slow)

The most accurate natural language detection library for Java and the JVM, suitable for long and short text alike

AI chatbot 🤖 for chat with CSV, PDF, TXT files 📄 and YTB videos 🎥 | using Langchain🦜 | OpenAI | Streamlit ⚡

XiaoMi Natural Language Processing Toolkits

OCTIS: Comparing Topic Models is Simple! A python package to optimize and evaluate topic models (accepted at EACL2021 demo track)

Connect and chat with your multiple documents (pdf and txt) through GPT 3.5, GPT-4 Turbo, Claude and Local Open-Source LLMs

Trankit is a Light-Weight Transformer-based Python Toolkit for Multilingual Natural Language Processing

LexNLP by LexPredict

A Neural Framework for MT Evaluation

DNABERT: pre-trained Bidirectional Encoder Representations from Transformers model for DNA-language in genome

Kiwi(지능형 한국어 형태소 분석기)

PatrickStar enables Larger, Faster, Greener Pretrained Models for NLP and democratizes AI for everyone.

Framework for enhancing LLMs for RAG tasks using fine-tuning.

深度学习近年来关于神经网络模型解释性的相关高引用/顶会论文(附带代码)

All-in-one text de-duplication

Python Implementations of Word Sense Disambiguation (WSD) Technologies.