#EMA (1)

SiamJEPA: On the Role of Siamese Student Encoders in JEPA

Investigates the effect of Siamese student encoders in JEPA-based self-supervised representation learning. SiamJEPA uses masked Siamese student encoders with an EMA teacher, acting as an effective regularizer that improves representation separability and accelerates early-stage learning, outperforming single-encoder JEPA variants under limited budgets.