当前位置: X-MOL 学术Softw. Pract. Exp. › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
Validating UTF‐8 in less than one instruction per byte
Software: Practice and Experience ( IF 2.6 ) Pub Date : 2020-10-29 , DOI: 10.1002/spe.2920
John Keiser 1 , Daniel Lemire 2
Affiliation  

The majority of text is stored in UTF-8, which must be validated on ingestion. We present the lookup algorithm, which outperforms UTF-8 validation routines used in many libraries and languages by more than 10 times using commonly available SIMD instructions. To ensure reproducibility, our work is freely available as open source software.

中文翻译:

以每字节少于一条指令的方式验证 UTF-8

大多数文本以 UTF-8 格式存储,必须在摄取时进行验证。我们提出了查找算法,该算法使用常用的 SIMD 指令比许多库和语言中使用的 UTF-8 验证例程高 10 倍以上。为了确保可重复性,我们的工作作为开源软件免费提供。
更新日期:2020-10-29
down
wechat
bug