Meta has introduced Llama 4, its latest assortment of AI fashions that now energy the Meta AI assistant on the net and in WhatsApp, Messenger, and Instagram. The 2 new fashions, additionally obtainable to obtain from Meta or Hugging Face, are Llama 4 Scout — a small mannequin able to “becoming in a single Nvidia H100 GPU” — and Llama 4 Maverick, which is extra akin to GPT-4o and Gemini 2.0 Flash. Meta says it’s nonetheless within the course of of coaching Llama 4 Behemoth, which Meta CEO Mark Zuckerberg says is “the very best performing base mannequin on the planet.”
In response to Meta, Llama 4 Scout has a 10-million-token context window — the working reminiscence of an AI mannequin — and beats Google’s Gemma 3 and Gemini 2.0 Flash-Lite fashions, in addition to the open-source Mistral 3.1, “throughout a broad vary of broadly reported benchmarks,” whereas nonetheless “becoming in a single Nvidia H100 GPU.” Meta makes comparable claims about its bigger Maverick mannequin’s efficiency versus OpenAI’s GPT-4o and Google’s Gemini 2.0 Flash, and says its outcomes are akin to DeepSeek-V3 in coding and reasoning duties utilizing “lower than half the energetic parameters.”
In the meantime, Llama 4 Behemoth has 288 billion energetic parameters with 2 trillion parameters in complete. Whereas it hasn’t been launched but, Meta says Behemoth can outperform its opponents (on this case GPT-4.5 and Claude Sonnet 3.7) “on a number of STEM benchmarks.”
For Llama 4, Meta says it switched to a “combination of specialists” (MoE) structure, an method that conserves assets by utilizing solely the elements of a mannequin which might be wanted for a given job. The corporate plans to debate future plans for AI fashions and merchandise at its LlamaCon convention, which is happening on April twenty ninth.
As with its previous fashions, Meta calls the Llama 4 assortment “open-source,” though Llama has been criticized for its license restrictions. As an example, the Llama 4 license requires industrial entities with greater than 700 million month-to-month energetic customers to request permission from Meta earlier than utilizing its fashions, which the Open Supply Initiative wrote in 2023 takes it “out of the class of ‘Open Supply.’”
