test/ModelLink2
1
0
Fork 0
mirror of https://gitee.com/ascend/ModelLink.git synced 2024-12-02 11:58:26 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity
4e3b7cd992
ModelLink2/ascendspeed/tokenizer
History
kingsleyandher 4e3b7cd992 LlamaTokenizer适配及预训练脚本更改
2023-06-13 12:33:33 +08:00
..
__init__.py change megatron to ascendspeed 2023-06-10 21:26:01 +08:00
bert_tokenization.py change megatron to ascendspeed 2023-06-10 21:26:01 +08:00
gpt2_tokenization.py change megatron to ascendspeed 2023-06-10 21:26:01 +08:00
tokenizer.py LlamaTokenizer适配及预训练脚本更改 2023-06-13 12:33:33 +08:00