A transformer block operating on image-latent tokens, modulated by the diffusion timestep.
Introduced inDec 2022Scalable Diffusion Models with Transformers
Diffusion transformers replace the classic U-Net with a stack of transformer blocks over patchified latent tokens. Each block is conditioned on the timestep (and prompt) through adaptive layer-norm modulation. The timestep embedding shifts and scales activations inside every block. DiTs scale more predictably than U-Nets and power most recent image and video generators.
Share of new models that have included DiT blocks over time.
Open any of these on hfviewer to find this block in the interactive architecture graph.
Browse all 254 models with this in the catalog →
hfviewer renders the full architecture of 3,500+ Hugging Face models as interactive graphs. Hover any block to see what it does, with this model’s real numbers.
Browse all model graphs →