Browse Models
The Solar model family, developed by Upstage AI, consists of open-weights large language models built upon transformer architectures like Llama 2 and Mistral. The family's primary member, SOLAR 10.7B released in December 2023, employs Depth Up-Scaling methodology to expand from 32 to 48 layers by concatenating two trimmed transformer instances, followed by continued pretraining and instruction fine-tuning with synthetic Direct Preference Optimization alignment.