Allen Ai2 (Medium)
· Open Source
OLMoE: An open, small, and state-of-the-art mixture-of-experts model
We’re introducing OLMoE, jointly developed with Contextual AI, which is the first mixture-of-experts model to join the OLMo family. OLMoE brings two important aspects to the space of truly open models — it is the first model to be on the Pareto frontier of performance and size, while also being released with open data,