Offline notes on frontier open models and an MSc dissertation. Tree: github.com/lyffseba/xai (private). Mirror: datasets/lyffseba/xai-studies.
| id | name | status | total | active | ctx | experts |
|---|---|---|---|---|---|---|
| inkling | Inkling | weights public | 975B | 41B | 1M | 6/256+2 |
| kimi-k3 | Kimi K3 | API live · weights pending | 2.8T | undisclosed | 1M | 16/896 |
| laguna-s-2.1 | Laguna S 2.1 | weights public | 118B | 8B | 1M | 10/256+1 |
Inkling — Thinking Machines MoE · relative PE · SWA/global · image+audio · Hub.
Laguna S 2.1 — Poolside 118B-A8B · agentic coding · Hub · poolside.ai/models.
Kimi K3 — Moonshot 2.8T · LatentMoE 16/896 · KDA+AttnRes · blog.
compare · study · sources · MSc