image credit: Freepik

Stability AI Releases 1.6 Billion Parameter Language Model Stable LM 2

January 30, 2024

Via: InfoQ

Stability AI released two sets of pre-trained model weights for Stable LM 2, a 1.6B parameter language model. Stable LM 2 is trained on 2 trillion tokens of text data from seven languages and can be run on common laptop computers.

Stable LM 2 is available in two versions: the base model and an instruction-tuned version called Stable LM 2 Zephyr. The base model was trained on data in Dutch, French, German, Italian, Portuguese, Spanish, and English. Stability AI used “recent algorithmic advancements in language modeling” to give the small model capabilities rivaling larger models.

Read More on InfoQ