LeJEPA: Provable and Scalable Self-Supervised Learning Without the Heuristics

Chimère Ω is a blueprint for a local-first LLM runtime that allocates computation across four modes (fast prediction, block-diffusion refinement, symbolic verification, latent-space planning) via a scheduler driven by token-level residual entropy rather than fixed architectural choices. The blueprint integrates verified Q4 2025–Q2 2026 state of the art: LeJEPA/SIGReg (Balestriero & LeCun, arXiv:2511.08544), hybrid Gated-DeltaNet + sparse-attention backbones (Qwen3-Next, Kimi-Linear), test-time memory optimisation. The thesis is that token-level residual entropy is a sufficient signal to schedule across modes and yield aggregate quality gains within a fixed local compute budget. Companion design document to the ECI framework (DOI 10.5281/zenodo.19708889).

Representation Learningwith Contrastive…Representation Learning with Contrastive Predictive CodingLearning deeprepresentations by…Learning deep representations by mutual information estimation and maximizationVICReg:Variance-Invariance-Cov…VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised LearningUnderstandingDimensional Collapse in…Understanding Dimensional Collapse in Contrastive Self-supervised LearningThe Hidden UniformCluster Prior in…The Hidden Uniform Cluster Prior in Self-Supervised LearningA Cookbook ofSelf-Supervised LearningA Cookbook of Self-Supervised LearningVision Transformers NeedRegistersVision Transformers Need RegistersDINOv2: Learning RobustVisual Features without…DINOv2: Learning Robust Visual Features without SupervisionLearning byReconstruction Produces…Learning by Reconstruction Produces Uninformative Features For PerceptionGaussian Embeddings: HowJEPAs Secretly Learn…Gaussian Embeddings: How JEPAs Secretly Learn Your Data DensityJoint Embedding vsReconstruction: Provabl…Joint Embedding vs Reconstruction: Provable Benefits of Latent Space Prediction for Self Supervised LearningDINOv3DINOv3VL-JEPA: Joint EmbeddingPredictive Architecture…VL-JEPA: Joint Embedding Predictive Architecture for Vision-languageKerJEPA: KernelDiscrepancies for…KerJEPA: Kernel Discrepancies for Euclidean Self-Supervised LearningLeWorldModel: StableEnd-to-End…LeWorldModel: Stable End-to-End Joint-Embedding Predictive Architecture from PixelsV-JEPA 2.1: UnlockingDense Features in Video…V-JEPA 2.1: Unlocking Dense Features in Video Self-Supervised LearningTemporal Straighteningfor Latent PlanningTemporal Straightening for Latent PlanningIConE: Batch IndependentCollapse Prevention for…IConE: Batch Independent Collapse Prevention for Self-Supervised Representation LearningHQ-JEPA: Hybrid QuantumJoint-Embedding…HQ-JEPA: Hybrid Quantum Joint-Embedding Predictive Architecture for Cross-Modal Remote Sensing Representation LearningVideo Generation Modelsin Robotics -…Video Generation Models in Robotics - Applications, Research Challenges, Future DirectionsLaya: A LeJEPA Approachto EEG via Latent…Laya: A LeJEPA Approach to EEG via Latent Prediction over ReconstructionPredictive but NotPlannable: RC-aux for…Predictive but Not Plannable: RC-aux for Latent World ModelsJEPA-DNA: GroundingGenomic Foundation…JEPA-DNA: Grounding Genomic Foundation Models through Joint-Embedding Predictive ArchitecturesPretext Matters: AnEmpirical Study of SSL…Pretext Matters: An Empirical Study of SSL Methods in Medical ImagingLeJEPA: Provable andScalable Self-Supervise…LeJEPA: Provable and Scalable Self-Supervised Learning Without the HeuristicsEarlier referencesFocus paperCiting papersOlderNewer

Click a node to pin it, click the empty canvas to go back to this paper, or hover to preview. Open a node’s page from its title.