Researchers prove the Platonic Representation Hypothesis with JEPA models
Separately trained JEPAs learn the same underlying representation, achieving image-text alignment with 42 times fewer training samples than next-token prediction. A 109M-parameter text JEPA outperforms LLMs up to 72B parameters on cross-modal alignment benchmarks.