Stability AI released two sets of pre-trained model weights for Stable LM 2, a 1.6B parameter language model. Stable LM 2 is trained on 2 trillion tokens of text data from seven languages and can be run on common laptop computers.
Stable LM 2 is available in two versions: the base model and an instruction-tuned version called Stable LM 2 Zephyr. The base model was trained on data in Dutch, French, German, Italian, Portuguese, Spanish, and English. Stability AI used “recent algorithmic advancements in language modeling” to give the small model capabilities rivaling larger models.
