ContextualAI/HALOs

A library with extensible implementations of DPO, KTO, PPO, ORPO, and other human-aware loss functions (HALOs).

↗ Open on GitHub

Stars

909

Forks

51

Language

Python

License

Apache-2.0

Last push

11 months ago

Python alignment rlhf ppo dpo halos kto

No related intel yet

This repo has not appeared in any of the sources the radar tracks. The collector runs on a schedule — check back once it covers this repo.