> ML_ARCHITECTURE // DIFFUSION-TRANSFORMER-DIT_v1.0
Diffusion Transformer (DiT / Sora / Flux)
Modern generative architecture replacing convolutional U-Nets with transformer backbones operating on latent spacetime patches, scaling compute predictable in high-fidelity generation.
Generative Transformersimagevideo
Back to All ArchitecturesArchitecture Overview
Modern generative architecture replacing convolutional U-Nets with transformer backbones operating on latent spacetime patches, scaling compute predictable in high-fidelity generation.
Implementing Libraries
PyTorchLinux Foundation / PyTorch Foundation · v2.4.1
View SpecSeminal Papers
Scalable Diffusion Models with Transformers (DiT)William Peebles, Saining Xie (2023) · IEEE International Conference on Computer Vision (ICCV)
Video generation models as world simulators (Sora)Tim Brooks, Bill Peebles (2024) · OpenAI Technical Report
Architectural Limitations & Constraints
- Requires compatible deep learning framework and hardware acceleration for efficient execution.
