AI Agent Hub
Back to models
Llama-4-Maverick-17B-128E-Instruct logo

Llama-4-Maverick-17B-128E-Instruct

Multimodal meta-llama Released 2025-04-05
9.0 / 100 400.0B params 1M context Open Source

About this model

Llama 4 Maverick 17B-128E-Instruct is Meta's instruction-tuned, natively multimodal mixture-of-experts model from the Llama 4 family. It activates 17 billion parameters per forward pass across 128 routed experts (about 400 billion total parameters), uses early-fusion multimodal training, and supports text plus image inputs for assistant-style chat, visual reasoning, captioning, and code generation. Meta pretrained it on roughly 22 trillion multimodal tokens with an August 2024 knowledge cutoff and released it on April 5, 2025 under the Llama 4 Community License.

On widely reported benchmarks, Maverick ranks among the strongest open multimodal models in its class. Instruction-tuned scores include 80.5 on MMLU-Pro, 69.8 on GPQA-Diamond, 73.4 on MMMU, 43.4 on LiveCodeBench, and 77.6 on MBPP, while the pretrained checkpoint reaches 85.5 MMLU and 61.2 MATH. Meta reports that an experimental chat build reached an Arena Elo of 1417, and the model competes with GPT-4o and Gemini 2.0 Flash on multimodal tasks while matching much larger models on reasoning and coding.

The model ships with a 1,048,576-token context window, twelve supported languages plus broader pretraining coverage, and both BF16 and FP8 checkpoints on Hugging Face. FP8 weights are designed to fit on a single 8xH100 DGX node, making Maverick practical for high-quality multimodal deployment despite its large total parameter count.

Editor's note

Written for AI Agent Hub. This is separate from the publisher description above.

What problem it solves

This is the instruct variant of Llama 4 Maverick in our index: an open, multimodal-marked listing meant for people who want Meta's instruct weights rather than a raw or FP8-only repack. The name encodes a mixture-of-experts shape. The total parameter story and the active parameters are different ideas. Do not plan memory from the larger story alone.

Who it is for

Operators who want an open instruct model with image input and a long claimed window, and who will read Meta's license for acceptable use. You can run or rent GPUs and you will test the instruct chat format the card implies.

Who should skip it

Skip the non-instruct and FP8 cards until this one is the model you meant. They are siblings. Skip it if Meta's license excludes your product. Our open-source badge will not argue with that license. Skip it for a pure text batch job if a smaller model you already serve is accurate enough. Multimodal capacity you do not use still costs memory.

First three steps

  1. Read the license and the prompt format upstream. Instruct models are picky about the template.
  2. Run a text task and one image task. Grade them separately. A model can pass one and fail the other.
  3. If memory is tight, then look at the FP8 row and repeat both tests. Adopt FP8 only if both grades hold.

Alternatives on this site

Other open notes on this site are GLM-5.2, Kimi-K3, and DeepSeek-V4-Flash-0731, which are not drop-in templates. Hosted multimodal models such as Gemini Flash are the alternative when you will not serve weights. Multimodal is a filter, not a ranking.

Questions

Is 17B the full model? The name says 17B with 128 experts. Plan capacity from the runtime's reported memory, not from the 17 alone and not from a back-of-the-envelope total.

Which Maverick row should the config name? The one you tested. Copy the id from that card, including Instruct if that is what passed.

Benchmark Scores

HLE
5.68
MATH
61.2
MBPP
77.6
MMMU
73.4
MMLU-Pro
80.5
SWE-Bench-Pro
5.24

Technical Specs

  • Parameters: 400.0B
  • Architecture: MoE Transformer
  • Context Window: 1,048,576 tokens
  • Input Modalities: text, image

Hardware Requirements

  • VRAM: 640.0 GB
  • Compute: 8x NVIDIA H100 80GB (FP8 quantized on a single DGX host); BF16 weights require multi-node deployment

Reader reviews

No approved reader reviews on this listing yet. Yours can be the first.

Reviews are held for moderation and appear after an editor approves them. No links or promotion.