Cross-Entropy Is All You Need To Invert the Data Generating Process | Robust Machine Learning – Max Planck Institute for Intelligent Systems

Institute Homepage

Institute Homepage Sign In

Research Overview

Comparative Vision Science

Does CLIP's Generalization Performance Mainly Stem from High Train-Test Similarity?

In Search of Forgotten Domain Generalization

Partial Success in Closing the Gap between Human and Machine Vision

Foundations of Machine Learning

Cross-Entropy Is All You Need To Invert the Data Generating Process

Contrastive Learning Inverts the Data Generating Process

Interaction Asymmetry: A General Principle for Learning Composable Abstractions

Mechanistic Interpretability

Measuring Per-Unit Interpretability at Scale Without Humans

Exemplary Natural Images explain CNN Activations better than State-Of-The-Art Feature Visualizations

How Well do Feature Visualizations Support Causal Understanding of CNN Activations?

Robust Machine Learning

Cross-Entropy Is All You Need To Invert the Data Generating Process

Here, we prove that models trained with cross-entropy in supervised learning can recover latent factors of the data-generating process up to a linear transformation, supported by both theoretical results and empirical evidence [

].