Skip to main content

> ML_ARCHITECTURE // SWIN-TRANSFORMER-HIERARCHICAL_v1.0

Swin Transformer (Hierarchical Shifted Window Transformer)

Hierarchical vision transformer computing self-attention within local shifted windows, delivering linear computational complexity with respect to image resolution for dense prediction.

Vision Transformersimage
Back to All Architectures

Architecture Overview

Hierarchical vision transformer computing self-attention within local shifted windows, delivering linear computational complexity with respect to image resolution for dense prediction.

Implementing Libraries

PyTorchLinux Foundation / PyTorch Foundation · v2.4.1
View Spec
torchvisionPyTorch Foundation / Meta · v0.19.1
View Spec
timm (PyTorch Image Models)Ross Wightman / Hugging Face · v1.0.9
View Spec

Seminal Papers

Swin Transformer: Hierarchical Vision Transformer using Shifted WindowsZe Liu, Yutong Lin (2021) · IEEE International Conference on Computer Vision (ICCV)
Architectural Limitations & Constraints
  • Requires compatible deep learning framework and hardware acceleration for efficient execution.