llama2

LangChain & Prompt Engineering tutorials on Large Language Models (LLMs) such as ChatGPT with custom data. Jupyter notebooks on loading and indexing data, creating prompt templates, CSV agents, and using retrieval QA chains to query the custom data. Projects for using a private LLM (Llama 2) for chat with PDF files, tweets sentiment analysis.

Chat with your documents using local AI

A FastAPI service for semantic text search using precomputed embeddings and advanced similarity measures, with built-in support for various file types through textract.

A throughput-oriented high-performance serving framework for LLMs

Empower Large Language Models (LLM) using Knowledge Graph based Retrieval-Augmented Generation (KG-RAG) for knowledge intensive tasks

[ICLR 2025] Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing. Your efficient and high-quality synthetic data generation pipeline!

Toolkit for fine-tuning, ablating and unit-testing open-source LLMs.

Sample to envision intelligent apps with Microsoft's Copilot stack for AI-infused product experiences.

A personal wearable AI that runs locally

[ICLR 2024] Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning

Uses ChatGPT API, Bard API, and Llama2, Python-Nmap, DNS Recon, PCAP and JWT recon modules and uses the GPT3 model to create vulnerability reports based on Nmap scan data, and DNS scan information. It can also perform subdomain enumeration to a great extent

[ECCV2024] Grounded Multimodal Large Language Model with Localized Visual Tokenization

LLM (Large Language Model) FineTuning

校招、秋招、春招、实习好项目，带你从零动手实现支持LLama2/3和Qwen2.5的大模型推理框架。

Train and Infer Powerful Sentence Embeddings with AnglE | 🔥 SOTA on STS and MTEB Leaderboard

Use Code Llama with Visual Studio Code and the Continue extension. A local LLM alternative to GitHub Copilot.

从0到1构建一个MiniLLM (pretrain+sft+dpo实践中)

[ACL 2024] Progressive LLaMA with Block Expansion.

Create knowledge graphs with LLMs