Memory-Efficient LLM Training by Various-Grained Low-Rank Projection of Gradients

Published in ICLR (Under review), 2026

Recommended citation: Yezhen Wang*, Zhouhao Yang*, et al. "Memory-Efficient LLM Training by Various-Grained Low-Rank Projection of Gradients." arXiv preprint arXiv:2505.01744 (2025). https://arxiv.org/abs/2505.01744