Product Launch · xiaohu.ai

MiniMax releases and open-sources H3: one model that understands text, images, video, and audio, generating 2K videos with sound directly

Describe reference materials across four modalities in one sentence, get a 2K video at a fraction of the cost of mainstream models. But what "open source" means here needs a closer look.

At a Glance
  • Give it a few images, a couple of videos, an audio clip, and a single sentence describing the relationships. It produces a video with native stereo sound. MiniMax has turned video generation into "directing your assets," and the weights are live on HuggingFace.
  • Output is 2K by default, priced at a fraction of what rivals charge for 1080p. But which part of the system is actually "open source" is the most common point of confusion here.
  • It's a Chinese company's open-source release, yet the license excludes the EU, the UK, South Korea, and the US. Mainland China is covered. The reason is written right in the license.
⚑ Sources include MiniMax's official release, the HuggingFace model card, and the license text. Performance claims are the vendor's own; the full technical report isn't out yet, and no third-party evaluations exist so far. H3's pricing is from the official pay-as-you-go rate card; competitor pricing comes from third-party compilations listed at the end.
What It Is

Direct images, video, and audio with a single sentence. The model untangles the reference relationships on its own.

MiniMax has released its next-generation video generation model, H3, along with the weights. It's a full-modality model that folds text, images, video, and audio into a single shared context, producing 2K video with stereo sound directly — up to 15 seconds per clip, at an API price under a third of mainstream models.

AI video used to mean juggling specialized tools: one model for text-to-video, another for image-to-video, a third for camera control. H3 folds all these tasks into a single model. You just say which reference does what, and it sorts out the relationships itself.

The signature example from the official release uses this prompt:

"Use the Hitchcock-style camera movement from reference video 1, have the character in image 2 sing, and match the voice to audio 3."

MiniMax official release example

Below are the three reference inputs given to the model, and the final output.

Reference 1: The video providing camera movement (Hitchcock zoom). Source: MiniMax
Reference 2: Character image
Reference 2: The character image who should "start singing." Source: MiniMax
Reference 3: The vocal track that the generated video's singing must match. Source: MiniMax
The result: the character from image 2 sings, the voice matches audio 3, and the camera follows video 1's movement — all orchestrated by that single line of text. Source: MiniMax

Per-generation reference limits: up to 9 images, 3 videos, and 3 audio clips (audio can't be used alone; it must accompany an image or video), for a total of no more than 12 files.

Related · Same race, rival entry
ByteDance releases Seedance 2.5: up to 30 seconds per clip, one instruction can steer 50 reference assets
ByteDance is also chasing the "direct your assets" idea. The two approaches are worth comparing side by side.
Sample Clips

2K, stereo sound, and use cases from ads to e-commerce. All official samples are below.

Official samples fall into two groups: ones showing raw capability (2K quality, native stereo) and ones showing use cases (intros, product pages, posters, ads). Headphones are recommended for the stereo clips — the model generates sound and picture together, so there's no post-production audio work.

Official 2K sample. The platform API outputs 2K by default. The open-source base model runs at 768p locally; getting 2K requires the official regeneration module (detailed in the "Open Source" section below). Source: MiniMax
Native stereo sample: the left and right channels track the spatial relationships in the scene. Source: MiniMax
Use case: Movie title sequence. Source: MiniMax
Use case: Product website promo. Source: MiniMax
Use case: Motion poster. Source: MiniMax
Use case: Ads & e-commerce. Other commercial scenarios MiniMax highlights: brand, product design, UI/UX, and gaming. Source: MiniMax
4-15 s
Output duration
2K
API default resolution
24 fps
Output frame rate
32kHz
Stereo audio
11
Languages with stable dialogue support
21:9-9:16
Aspect ratio range
Pricing

2K costs less than half of what rivals charge for 1080p.

The official rate card is straightforward: $0.13/second for 2K, $0.08/second for 768p. The release post says "2K pricing is under a third of mainstream models," and a third-party pricing comparison lays that out concretely:

MiniMax H3 · 2K$7.8/min
Kling 3.0 · 1080p$20.16/min
Seedance 2.0 · 1080p$22.45/min
Per-second prices converted to per-minute. H3's two tiers ($0.13/s at 2K, $0.08/s at 768p) are from the official pay-as-you-go rate card (platform.minimax.io, verified 2026-08-03). Kling and Seedance figures are from a third-party compilation (August 2026). The official post doesn't name which "mainstream model" it refers to.

2K resolution at less than half the price of a rival's 1080p. The low cost and the versatility come from the same design decision.

Design Philosophy

It used to be one model per task. H3 tore that wall down.

Let's start with the old world. Image generation was split by task: text-to-image, editing, subject reference, style reference — each had its own specialist model. In audio, voice, sound effects, and music were three separate research tracks. Video was the most fragmented: text-to-video, image-to-video, first/last frame, subject reference, motion reference, editing — all separate. Users had to shuffle assets between tools, and models only ever saw their own narrow slice of data. Task boundaries capped generalization.

H3's first principle: tear that wall down. From the first day of pre-training, text-to-image, text-to-video, and text-to-audio train together. Video comes with sound natively; voice, effects, and music aren't siloed. "Reference" and "edit" are no longer fixed task lists but relationships described in natural language. That capability trains on real, natural data entirely, and it scales with data volume. Language becomes the bridge for task generalization.

Before: one expert model per task Text-to-Video Image-to-Video First/Last Frame Subject Ref. Motion Ref. Video Editing Voice & SFX Music Now: all tasks trained together H3: One modelAudio + Visual · refs via language "Use the camera from video 1, have the char in image 2 sing,voice from audio 3" — instructions replace task menus
Before: tasks were split across expert models. H3 trains them all together from the start, with "what references what" expressed in natural language. Illustration by xiaohu.ai.
How It Works

Four techniques, all in service of task generalization.

1. Describing assets down to the "relationship" level

Generative models learn from "asset + description" pairs. H3 takes description writing down to the relationship level: not just describing the target video, but also the relationships between reference assets, the relationship between references and the target, and the audio-visual correspondence across multiple shots. MiniMax calls this Contextual Omni Representation. For this, they built a dedicated understanding pipeline: each training asset averages around 100k tokens of inference (roughly the length of a short novel), distilled into a precise description of about 4k tokens. H3's ability to follow instructions — "you say it, it gets it" — is rooted here.

Understanding inference per asset ~100k tokens Distilled precise description ~4k tokens, just 1/25th
The equivalent of a short novel's worth of inference, compressed into a few pages of relationship-level description, then used to train the model. Illustration by xiaohu.ai.

2. H3-VAE: A complete rewrite of the video compressor

Analogy

A VAE is like the zip for video: it compresses video into a "package" the model can process, then decompresses it back into frames after generation. The harder the compression, the shorter the sequence the model has to handle, and the cheaper it is. H3 rewrote this zip algorithm entirely.

The new compressor reduces spatial dimensions by 16x and temporal by 4x. After patching into the model, the effective spatial compression is 32x. This yields 4x the effective sequence length, dramatically cutting training and inference costs. That's what makes 2K affordable. On the audio side, the same compressor processes each stereo channel separately before merging, so stereo is inherent, at a 32kHz sample rate.

3. Generation core: 33B parameters, one network, modalities stay together

The generation core is a 33B-parameter dense, single-stream Transformer. Attention and feed-forward layers don't distinguish between modalities. Modal differences live only in the input/output layers and the AdaLN branches — side pathways that send a "what type of content is being generated right now" control signal to each layer. Roughly 13B of the 33B parameters are in the AdaLN branches, and these can be pre-computed and cached, so they don't need to be loaded during inference:

Inference active ≈20B
AdaLN ≈13B · Cacheable, not loaded
Breakdown of the 33B parameters. Actual inference load is about 20B. For fine-tuning, MiniMax releases the full 33B weights.

The model card also reveals two engineering choices. First, the text and vision encoders directly use the full pre-trained weights of Alibaba's open-source Qwen3-VL-32B, feeding the hidden states from its 50th layer into the generation core — domestic open-source models using each other as components. Second, the architectural advantages accumulated in Hailuo 02 were entirely abandoned. That architecture was "redundant complexity for a model designed around task generalization." The thinking: architectures yield to model definitions. On the training side, "understanding" and "generation" compute loads are scheduled separately, boosting end-to-end training throughput by nearly 30%. Sparse attention for long sequences is natively trained, but the initial release only includes dense attention inference. The sparse implementation will be released separately later.

H3-Base architecture diagram
Official H3-Base architecture: text goes through the H3-Encoder (Qwen3-VL-32B), images go through both the encoder and a vision VAE, audio goes through an audio VAE. Everything is packed into a single sequence for the Omni Transformer, then decoded separately into video and stereo audio. Source: HuggingFace model card

4. 2K is re-generated with the original assets in hand

The traditional approach trains a dedicated super-resolution module to upscale 768p footage. Blurry small text and fine textures are mostly guessed. H3's 2K path is different: the base model carries the original reference assets and re-generates its own 768p draft from scratch. Because the original context is still available, small text and details can be genuinely recovered. Again, task generalization in action — upscaling is just another form of "generation."

Traditional SR route 768p draft SR module Upscaled · details guessed H3 · In-Context Regeneration 768p draft Original refs also included Base regenerates 2K outputText & details recovered
Super-resolution guesses based on a blurry image. H3 re-generates with the original assets, recovering details from context. Illustration by xiaohu.ai.
Open Source Boundaries

Only the middle of the three-stage pipeline is open. Pre-processing and 2K require the official API.

The full H3 system is a three-stage pipeline, and only the middle stage has its weights released:

H3-Context-IRPre-processing · input"crucial to output quality"API only · closed H3-BaseGenerates 768p AVFL2VA + Ref2VA weightsWeights open H3-Regenerate-2KRe-gen with context"will release later"API only · closed ↑ Use official API ↑ Run locally ↑ Use official API To replicate official 2K locally: deploy the middle, but both ends need the official API Note: native sparse attention is not in this release either. MiniMax says it will be published separately.
The open source boundary of H3's three-stage pipeline. Based on the HuggingFace model card. Illustration by xiaohu.ai.
H3-Context-IRPre-processing · input · crucialAPI only · closed↓ Use official API H3-BaseGenerates 768p AV · FL2VA + Ref2VAWeights open↓ Run locally H3-Regenerate-2KContext-aware re-gen · "later"API only · closed↓ Use official API Local 2K = deploy middleofficial API on both endsSparse attention not in initial release
The open source boundary of H3's three-stage pipeline. Based on the HuggingFace model card. Illustration by xiaohu.ai.

Stage by stage. The front end, Context-IR, handles your jumbled input — a few images, clips, a sentence — and turns it into structured descriptions for the generation model. It's "crucial to final output quality" (the model card's words), but it's not open-sourced — it relies on multi-stage workflows and multiple hosted models. Only the API is provided, along with two prompt-writing guides for the community to build this layer themselves. The middle, H3-Base, is the genuinely open part: two sets of weights. FL2VA handles text-to-video and first/last frame. Ref2VA handles full-modality reference. Both are CFG-distilled, BF16, outputting 768p. The back end, Regenerate-2K, "is complex, will release when ready" — API-only for now.

Both API ends have clear pricing. Pre-processing (Context-IR) is billed per token: $0.90 per million input tokens, $3.60 per million output. The 768p-to-2K regeneration is billed per second of output: $0.05/second, plus you pay the input fee for your original assets again. Running 768p locally costs nothing. For official-grade 2K, expect roughly $3 extra per minute.

The deployment ecosystem was complete at launch: SGLang, vLLM, diffusers, and ComfyUI all supported on day one. The official example command uses 4 GPUs; exact VRAM requirements aren't specified. Native ComfyUI support went live the same day as the weights, organizing H3's capabilities into five task types: text-to-video, image-to-video, first/last-frame control, reference-to-video, and in-place editing (modifying existing shots directly, avoiding full regeneration). Workflow templates and tutorials are ready to download.

Official ComfyUI demo: native support on launch day, five video tasks sharing one model. Source: ComfyUI
H3 system overview diagram
Official system overview: the division of labor between Context-IR, H3-Base, and Regenerate-2K. Source: HuggingFace model card
License

Available worldwide, except the EU, UK, South Korea, and the US.

Downloadable weights don't mean usable everywhere — and the direction is the opposite of what most people assume. H3 uses MiniMax's own community license (MiniMax H3 Community License). The territory clause reads: "worldwide, excluding the following regions." Those are the EU, the UK, South Korea, and the US. Mainland China is in the licensed territory. Download and use. For the four excluded regions, you need to apply; MiniMax reviews the deployment scenario and compliance before granting a separate license.

✓ Licensed: rest of the world
  • Includes mainland China
  • Download and use; fine-tune and redistribute allowed
  • Subject to license & acceptable use policy
The four excluded regions
  • EU / UK / South Korea / US
  • File an official application
  • Review of deployment & compliance
  • Separate authorization if approved
The API is not subject to this restriction and is available worldwide, including in those four regions.

The logic behind the exclusion list: where regulation is tightening, weights aren't provided first. The EU's AI Act is already in enforcement. The UK and South Korea have similar uncertainty. The US has an extra layer — the license FAQ explicitly points to a lawsuit MiniMax is involved in:

"In the US, AI regulation is still changing rapidly, and MiniMax itself is party to copyright-related litigation specifically targeting generative video AI."

MiniMax H3 License FAQ (translated by xiaohu.ai)

The FAQ ends with a promise: the current scope reflects the regulatory reality today. "It's 'not yet,' not 'never.'" Future changes will be announced explicitly, not silently updated.

What's Next

No technical report yet. The claims are on the books, pending review.

Three things are in progress: a full technical report (the page just says "soon"); the next H-series model integrating MiniMax's own M-series language model capabilities; and continued scaling of model size and visual fidelity. The vendor also listed its own weaknesses at the end of the release post: multimodal understanding still has significant room for improvement, and visual details in some scenarios still need work.

Until the technical report and third-party evaluations are out, phrases like "production-ready quality" and "excellent instruction following," as well as the unnamed "mainstream model" in the pricing comparison, are all the vendor's own claims. The sample clips are above. You can check them yourself.

🧰 Quick Start · MiniMax H3
PriceWeb: trial available; API official rates: 2K $0.13/s, 768p $0.08/s
BarrierWeb: zero. Local: 768p base only; official example uses 4 GPUs
Sources
MiniMax H3: An Open Model Breaking the Boundaries Between Tasks and ModalitiesMiniMax·Official release·2026-07-31
Editor's note
Sample clips, example assets, and the two architecture diagrams are from MiniMax's official release and HuggingFace model card. The three-stage pipeline diagram, the "tearing down the wall" diagram, and the distillation/regeneration illustrations were created by xiaohu.ai. License territory statement is based on the license agreement text (Applicable Territory clause). H3's pricing (2K $0.13/s, 768p $0.08/s, regeneration $0.05/s, Context-IR per token) is from the official pay-as-you-go page (platform.minimax.io, 2026-08-03). Kling/Seedance comparison pricing is from third-party compilations (GlobalGPT/AtlasCloud, August 2026). All qualitative claims are the vendor's own. The technical report and third-party evaluations are not yet available.