Diffusion & generation

DiT block (diffusion transformer)

A transformer block operating on image-latent tokens, modulated by the diffusion timestep.

First page of Scalable Diffusion Models with TransformersIntroduced inDec 2022Scalable Diffusion Models with TransformersPeebles & Xie · arXiv 2212.09748 ↗
DiT block: a transformer steered by timelatent tokens pass through attention and MLP while the timestep steers each normattentionMLPt + promptscale + shift

Diffusion transformers replace the classic U-Net with a stack of transformer blocks over patchified latent tokens. Each block is conditioned on the timestep (and prompt) through adaptive layer-norm modulation. The timestep embedding shifts and scales activations inside every block. DiTs scale more predictably than U-Nets and power most recent image and video generators.

Adoption over time

Share of new models that have included DiT blocks over time.

8%202220232024202520268%20222023202420252026

See it in real models

Open any of these on hfviewer to find this block in the interactive architecture graph.

Comfy-Org/MiniMax-H3 architecture graphComfy-Org/MiniMax-H3↓ 11.8M · ♡ 1kOpen in visualizer coqui/XTTS-v2 architecture graphcoqui/XTTS-v2text-to-speech · ↓ 8.7M · ♡ 4kOpen in visualizer ResembleAI/chatterbox architecture graphResembleAI/chatterboxtext-to-speech · ↓ 2.1M · ♡ 2kOpen in visualizer MiniMaxAI/MiniMax-H3 architecture graphMiniMaxAI/MiniMax-H3image-text-to-video · ↓ 2.0M · ♡ 4kOpen in visualizer Lightricks/LTX-2.3 architecture graphLightricks/LTX-2.3image-to-video · ↓ 1.7M · ♡ 2kOpen in visualizer stable-diffusion-v1-5/stable-diffusion-v1-5 architecture graphstable-diffusion-v1-5/stable-diffusion-v1-5text-to-image · ↓ 1.5M · ♡ 1kOpen in visualizer stabilityai/stable-diffusion-xl-base-1.0 architecture graphstabilityai/stable-diffusion-xl-base-1.0text-to-image · ↓ 1.5M · ♡ 8kOpen in visualizer Qwen/Qwen2.5-Omni-3B architecture graphQwen/Qwen2.5-Omni-3Bany-to-any · ↓ 1.4M · ♡ 345Open in visualizer stabilityai/sdxl-turbo architecture graphstabilityai/sdxl-turbotext-to-image · ↓ 1.3M · ♡ 3kOpen in visualizer black-forest-labs/FLUX.2-dev architecture graphblack-forest-labs/FLUX.2-devimage-to-image · ↓ 1.1M · ♡ 2kOpen in visualizer Tongyi-MAI/Z-Image-Turbo architecture graphTongyi-MAI/Z-Image-Turbotext-to-image · ↓ 934k · ♡ 5kOpen in visualizer microsoft/VibeVoice-ASR architecture graphmicrosoft/VibeVoice-ASRautomatic-speech-recognition · ↓ 682k · ♡ 1kOpen in visualizer

Browse all 254 models with this in the catalog →

Related concepts

hfviewer renders the full architecture of 3,500+ Hugging Face models as interactive graphs. Hover any block to see what it does, with this model’s real numbers.

Browse all model graphs →