AMA about K2 Horizon, Meet our team from IFM

Hi r/LocalLLaMA!

We’re researchers at the Institute of Foundation Models (IFM), an AI research lab dedicated to open and independent development of frontier-class foundation models.

We recently released K2 Horizon a connected fleet of six fully open models with size ranging from 0.9B to 375B. In addition to weights, we also open-sourced training data and recipes, training code, intermediate checkpoints, fine-grained training logs and evals.

Ask us anything about pre-training and data mixes, post-training, small models on-device, MoVA and sparse attention, deployment, what’s out now, and what’s coming next.

Participating in the AMA:

• Hector Liu u/hunterhector
• Alexander Moreno u/IFMAlex
• Mikhail Yurochkin u/my-moonfolk
• Rupesh Srivastava u/k2pt
• Junlin Chen u/Junlin_Chen110
• Haonan Li u/East-Career9147

We'll be live Mon, Oct 5, 8–10 PM PT. Questions are open now, so drop yours anytime!

https://preview.redd.it/awu0r6fbowsh1.png?width=3240&format=png&auto=webp&s=860018e2d8aeb7575a1ddd11ed2c2f735948938d