v1.2.3

• Support Flash Attention
• Set tokenizer.padding_side = right as default #21
• Add unittest

v1.2.2

• Optimize VRAM for calculating pos_bias
• support context extrapolation
• bug fixed

v1.2.1

• Support: MixedNTKScaleRoPE & FixedBasedNTKScaleRoPE; please check this blog for more details

v1.2.0

• Support extended Ernie_layout with RoPE and Alibi #17

v1.1.0

• Clean redundant codes
• Rewrite tokenizer and processor to support bbox, question and labels as input #14
• Fix misleading between num_class and num_labels #18

v1.0.0

A stable implementation of ERNIE-Layout in Pytorch