Inspur Information released the "Source 2.0-M32" open source model...
DIYuan | 2024-05-28 17:19
【數(shù)據(jù)猿導(dǎo)讀】 Inspur Information released the "Source 2.0-M32" open source model
On May 28, Inspur Information released the "Source 2.0-M32" open source model. Based on the Source 2.0 series of large models, the model adopts the technology of "attention mechanic-based gated network" to build a hybrid expert model (MoE) containing 32 experts, and greatly improves the computing efficiency of the model. With a specially optimized model architecture, the M32 achieves the same level of performance as the 70-billion-parameter LLaMA3 with only 3.7 billion parameters activated, and consumes only 1/19 of the computing power of the LLaMA3.
來源：DIYuan
刷新相關(guān)文章
我要評論
不容錯過的資訊
-
1喜訊｜預(yù)策科技獲得阿里巴巴前參謀長曾鳴
-
2《2024中國AI大模型產(chǎn)業(yè)圖譜1.0版》重磅
-
3《2024中國數(shù)據(jù)要素產(chǎn)業(yè)圖譜1.0版》重磅
-
4CBDT 2024第二屆中國出海品牌數(shù)字科技峰
-
5Huasheng Tiancheng officially join
-
6馬斯克計劃推出xAI超級計算機；中國移動
-
7Alipay releases "Pilot" intellig
-
8xAI據(jù)悉接近完成近60億美元融資；前圖森
-
9字節(jié)AI Bot扣子底層已接入通義千問、Min
-
10勵銷云回應(yīng)公開售賣企業(yè)家數(shù)據(jù)；騰訊云、
大數(shù)據(jù)企業(yè)推薦more >
大家都在搜
