Skip to main content

> ML_ALGORITHM // MOMENTUM-CONTRAST-MOCO_v1.0

Momentum Contrast (MoCo v1 / v2 / v3)

Contrastive learning mechanism modeling contrastive pairs as dynamic dictionary lookups using a memory queue and a momentum-updated encoder.

Contrastive Representation Learningself-supervisedblack-boxlarge (>100k)
Back to All Algorithms
Computational Complexity
Training Complexity:O(epochs * batch_size * (forward_pass + queue_size))
Inference Complexity:O(forward_pass)
Hardware Profile
CPU Friendly:No
Requires GPU:Yes
Memory Footprint:moderate
Interpretability & Data
Interpretability Tier:black-box
Training Data Needs:large (>100k)

Interpretability Assessment

Learns a contrastive metric space uncoupled from mini-batch GPU memory constraints.

Suitable Tasks & Supported Modalities

Suitable Tasks:
feature extractionimage classificationobject detection
Supported Modalities:
image

Implementing Libraries

PyTorchLinux Foundation / PyTorch Foundation · v2.4.1
View Spec
torchvision

Foundational Literature

Momentum Contrast for Unsupervised Visual Representation Learning (MoCo)Kaiming He, Haoqi Fan (2020) · IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
Common Pitfalls & Warnings
  • Updating the momentum encoder with gradients rather than pure exponential moving average causes representation collapse