互联网 [论文笔记] PAI-Megatron 1、Qwen continuing pretrain(CT)千问预训练 本文介绍: 数据情况：预训练数据已经用qwen-tokenizer分过词。所以不需要准备数据...
![[论文笔记] PAI-Megatron 1、Qwen continuing pretrain(CT)千问预训练](http://www.7code.cn/wp-content/uploads/2023/11/ee6748cbc735e6105405f8a984d954c804b93f34bc916-Z0IqTf_fw1200.png)
