Alibaba Tongyi Qianwen Qwen2 big model released and synchronous open source...
【數(shù)據(jù)猿導(dǎo)讀】 Alibaba Tongyi Qianwen Qwen2 big model released and synchronous open source
June 7 news, Alibaba Tongyi Qianwen Qwen2 big model released today, and synchronously open source on Hugging Face and ModelScope. The Qwen2 series includes five sizes of pre-training and instruction fine-tuning models, including the QWEN2-0.5B, QWEN2-1.5B, QWEN2-7B, QWEN2-57B-A14B and QWEN2-72B, which are said to outperform the strongest open source model in the United States, the Llama3-70B; In addition to Chinese and English, 27 language-related data were added to the model training data, which improved the multilingual ability of the model. Context length supports further extension up to 128K tokens.
來源：DIYuan
