Inkling

Thinking Machines · open MoE · weights public

~975B total / 41B active · 1M ctx · native image+audio → text. Apache 2.0. Released 2026-07-15.

piece	choice
body	66 layers · hidden 6144
FFN	dense L0–1 · MoE L2–65
MoE	256 routed · top-6 · 2 shared · sink
attn	55 SWA (512) · 11 global
position	relative PE (d_rel=16) · not RoPE
local	SConv k=4 · 4 states/layer
vision/audio	hMLP p=40 · dMel 80×16

text|image|audio → d=6144
  → SWA/global + relative R + SConv
  → MoE 6/256+2
  → text (+ effort)

Hub · package · vs Kimi K3