Tencent/TurboTransformers

a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc) on CPU and GPU.

↗ Open on GitHub

Stars

1,550

Forks

208

Language

C++

License

NOASSERTION

Last push

1 year ago

C++transformer pytorch gpu decoder nlp inference bert machine-translation roberta huggingface-transformers gpt2 albert

No related intel yet

This repo has not appeared in any of the sources the radar tracks. The collector runs on a schedule — check back once it covers this repo.