Scaling Language Model Size in Cross-Device Federated Learning

Jae Ro, Theresa Breiner, Lara McConnaughey, Mingqing Chen, Ananda Suresh, Shankar Kumar, Rajiv Mathews. Proceedings of the First Workshop on Federated Learning for Natural Language Processing (FL4NLP 2022). 2022.