Skip to main content
buildradar
Sign in

niieani/gpt-tokenizer

@niieani

The fastest JavaScript BPE Tokenizer Encoder Decoder for OpenAI's GPT models (gpt-5, gpt-o*, gpt-4o, etc.). Port of OpenAI's tiktoken with additional features.

Stars
841
Forks
59
Language
TypeScript
License
MIT
Last push
4 weeks ago
TypeScriptopenaimachine-learningdecoderencodertokenizergpt-3gpt-4gpt-4ogpt-2gpt-5bpegpt-o1

No related intel yet

This repo has not appeared in any of the sources the radar tracks. The collector runs on a schedule — check back once it covers this repo.