# Meta's Next Llama AI Models Training on Unprecedented GPU Cluster! 🚀

**URL:** <https://onehack.st/t/metas-next-llama-ai-models-training-on-unprecedented-gpu-cluster/294863>\
**Category:** News & Articles\
**Tags:** technology\
**Created:** [November 1, 2024, 3:05pm UTC](https://onehack.st/t/metas-next-llama-ai-models-training-on-unprecedented-gpu-cluster/294863 "2024-11-01T15:05:21Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![TheJoker](https://onehack.st/user_avatar/onehack.st/thejoker/32/22660_2.png) [@TheJoker](https://onehack.st/u/TheJoker)\
**Post date:** [November 1, 2024, 3:05pm UTC](https://onehack.st/t/metas-next-llama-ai-models-training-on-unprecedented-gpu-cluster/294863/1 "2024-11-01T15:05:22Z")

</div>

**Summary:**

1. **Groundbreaking AI Training**  
Meta is training its next Llama AI model, **Llama 4** , on a GPU cluster described by CEO **Mark Zuckerberg** as “bigger than anything” previously reported.

2. **Impressive Scale**  
The training cluster exceeds **100,000 H100 Nvidia chips** , showcasing Meta’s ambition to push the boundaries of AI capabilities.

3. **Upcoming Launch**  
Zuckerberg indicated that the initial launch of Llama 4 is expected in early **2025** , with smaller models likely to be released first.

4. **Importance of Scale**  
Increasing the scale of AI training through enhanced computing power and data is seen as essential for developing more advanced AI models.

5. **Competitive Landscape**  
While Meta currently leads in this endeavor, other major players in AI are also working towards similar large-scale compute clusters, indicating a rapidly evolving field.

**Read more at:** [Wired](https://www.wired.com/story/meta-llama-ai-gpu-training/)