一万困难户，十万刚起步，百万才算富，Meta 超越 xAI 计划打造全球最大 GPU 集群！

云深知网络

2024-11-05

导读：军备竞赛刚刚开始

马斯克

不得不说是营销高手

数量未知的十万卡超级集群

从建设到运营始终是行业关注的焦点

122 天组装完成号称建造最快的AI数据中心

只是重要供应商

这位华裔 CEO 的日子有点难过

公司股价一夜暴跌33%蒸发近95亿美元

一万困难户

十万刚起步

百万才算富

Meta 在财报会议上表示

该公司的 Llama 4 模型正在一个

比十万 H100 AI GPU 更大的集群上训练

The Llama 3 models have been something of an inflection point in the industry. But I'm even more excited about Llama 4, which is now well into its development. We're training the Llama 4 models on a cluster that is bigger than 100,000 H100s or bigger than anything that I've seen reported for what others are doing. I expect that the smaller Llama 4 models will be ready first, and they'll be ready, we expect, sometime early next year.

Llama3 405B

采用 RoCE 技术组网