Linear Recursive Feature Machines provably recover low-rank matrices

Proceedings of the National Academy of Sciences, Volume 122, Issue 13, April 2025.
SignificanceUnderstanding the mechanism of how neural networks learn features from data is a fundamental problem in machine learning. Our work explicitly connects the mechanism of neural feature learning to a widely used class of algorithms for sparse …
Read More