January 1, 2023Open Access

GPT-wee: How Small Can a Small Language Model Really Get?

Key Points

Key points are not available for this paper at this time.

Abstract

Bunzeck B, Zarrieß S. GPT-wee: How Small Can a Small Language Model Really Get? In: Warstadt A, Mueller A, Choshen L, et al., eds. Proceedings of the BabyLM Challenge at the 27th Conference on Computational Natural Language Learning. Stroudsburg, PA: Association for Computational Linguistics; 2023: 35-46.

Perguntar à IA

Bookmark

View Full Paper

Cite This Study

Bunzeck et al. (Sun,) studied this question.

synapsesocial.com/papers/6a0f4263d6d1d245e0ed0c55 https://doi.org/https://doi.org/10.18653/v1/2023.conll-babylm.2

Also Consider

Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context:

1Evolving Neural Networks through Augmenting Topologies2002 · 3,251 citations
2Call for Papers -- The BabyLM Challenge: Sample-efficient pretraining on a developmentally plausible corpus2023 · 16 citations
3Where does language come from? Some reflections on the role of deictic gesture and demonstratives in the evolution of language2013 · 68 citations
4<b>The Psycho-Biology of Language.</b> Pp. ix + 336 and 7 plates. By George K. Zipf. Boston: Houghton Mifflin Co., 1935.1936 · 732 citations
5First Language Acquisition2010 · 116 citations

Perguntar à IA

Bookmark

View Full Paper