Skip to main content

> ML_ARCHITECTURE // DIFFUSION-TRANSFORMER-DIT_v1.0

Diffusion Transformer (DiT / Sora / Flux)

Modern generative architecture replacing convolutional U-Nets with transformer backbones operating on latent spacetime patches, scaling compute predictable in high-fidelity generation.

Generative Transformersimagevideo
Back to All Architectures

Architecture Overview

Modern generative architecture replacing convolutional U-Nets with transformer backbones operating on latent spacetime patches, scaling compute predictable in high-fidelity generation.

Implementing Libraries

PyTorchLinux Foundation / PyTorch Foundation · v2.4.1
View Spec

Seminal Papers

Scalable Diffusion Models with Transformers (DiT)William Peebles, Saining Xie (2023) · IEEE International Conference on Computer Vision (ICCV)
Video generation models as world simulators (Sora)Tim Brooks, Bill Peebles (2024) · OpenAI Technical Report
Architectural Limitations & Constraints
  • Requires compatible deep learning framework and hardware acceleration for efficient execution.