information-retrieval

Information Gathering Instagram.

List of software that allows searching the web with the assistance of AI: https://hf.co/spaces/felladrin/awesome-ai-web-search

A Collection of BM25 Algorithms in Python

Highly Performant, Modular, Memory Safe and Production-ready Inference, Ingestion and Indexing built in Rust 🦀

Information Gathering tool - DNS / Subdomains / Ports / Directories enumeration

Anserini is a Lucene toolkit for reproducible information retrieval research

Open CLI for integrating AI search, recommendation, and conversational retrieval into agent systems and business systems

PISA: Performant Indexes and Search for Academia

RAFT contains fundamental widely-used algorithms and primitives for machine learning and information retrieval. The algorithms are CUDA-accelerated and form building blocks for more easily writing high performance applications.

SPLADE: sparse neural search (SIGIR21, SIGIR22)

allRank is a framework for training learning-to-rank neural models based on PyTorch.

RAG-Fusion: multi-query generation + Reciprocal Rank Fusion for better retrieval-augmented generation. Includes evaluation harness with NFCorpus/BEIR.

Late Interaction Models Training & Retrieval

SGPT: GPT Sentence Embeddings for Semantic Search

[EMNLP'25] s3 - ⚡ Efficient & Effective Search Agent Training via RL for RAG (RLVR for Search with Minimal Data)

cuVS - a library for vector search and clustering on the GPU

Framework for enhancing LLMs for RAG tasks using fine-tuning.

Tevatron - Unified Document Retrieval Toolkit across Scale, Language, and Modality. Demo in SIGIR 2023, SIGIR 2025.

Straightforward fuzzy matching, information retrieval and NLP building blocks for JavaScript.

[COLM’25] DeepRetrieval — 🔥 Training Search Agent by RLVR with Retrieval Outcome

Generative Representational Instruction Tuning

⚡️A Blazing-Fast Python Library for Ranking Evaluation, Comparison, and Fusion 🐍

🔥 Rankify: A Comprehensive Python Toolkit for Retrieval, Re-Ranking, and Retrieval-Augmented Generation 🔥. Our toolkit integrates 40 pre-retrieved benchmark datasets and supports 7+ retrieval techniques, 24+ state-of-the-art Reranking models, and multiple RAG methods.

AI-first Search & Answer Engine for work. Open-source alternative to Glean.

A curated list of awesome papers related to pre-trained models for information retrieval (a.k.a., pretraining for IR).

Is ChatGPT Good at Search? LLMs as Re-Ranking Agent [EMNLP 2023 Outstanding Paper Award]

Open-source infrastructure that turns scattered SKILL.md files into curated, retrieval-ready agent-skill corpora—with retrieval and evaluation tooling included.

🍁 Sycamore is an LLM-powered search and analytics platform for unstructured data.

Minimalist web-searching platform with an AI assistant that runs directly from your browser. Demo: https://felladrin-minisearch.hf.space