LightSeq is a high performance inference library for sequence processing and generation implemented in CUDA. To our best knowledge, this is the first open-source inference library which fully supports highly efficient computation of modern NLP models such as BERT, GPT, Transformer, etc. This library is efficient, functional and convenient. A demo usage can be found here: https://github.com/bytedance/lightseq/blob/master/example.

中文翻译：

---

LightSeq：用于序列处理和生成的高性能推理库

LightSeq 是在 CUDA 中实现的用于序列处理和生成的高性能推理库。据我们所知，这是第一个完全支持现代 NLP 模型（如 BERT、GPT、Transformer 等）的高效计算的开源推理库。该库高效、实用且方便。可以在此处找到演示用法：https://github.com/bytedance/lightseq/blob/master/example。