Skip to main content

> ML_LITERATURE // HE-2020-MOMENTUM-CONTRAST-UNSUPERVISED-VISUAL-REPRESENTATION-MOCO_v1.0

Momentum Contrast for Unsupervised Visual Representation Learning (MoCo)

Kaiming He, Haoqi Fan, Yuxin Wu, Saining Xie, Ross Girshick · IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2020)

algorithm2020foundationalthirdPartyReproduced

Principal Contribution

Framed contrastive learning as dictionary look-up with a dynamic queue of negative keys and a momentum-updated key encoder, decoupling dictionary size from mini-batch size.

Operational Relevance

Serves as qualified reference for deploying task-feature-extraction, task-image-classification in production.

Assumptions

  • Spatial feature coherence and data manifold structure adhere to continuous representation hypotheses

Limitations

  • Computational complexity scales with spatial resolution and parameter capacity

Connected Algorithms, Architectures & Tools

Related Algorithms:
Related Architectures:
Implementing Libraries: