Tencent releases Apache‑2 Hy3 MoE
New 295B‑parameter Mixture‑of‑Experts with 21B active parameters and a multi‑token prediction layer, released under Apache 2.0, signaling a stronger open model push from China.
tencent/Hy3 — <p><strong><a href="https://huggingface.co/tencent/Hy3">tencent/Hy3</a></strong></p> New Apache 2.0 licensed model from Tencent in China:</p> <blockquote> <p>Hy3 is a 295B-parameter Mixture-of-Experts (MoE) model with 21B active parameters and 3.8B MTP layer parameters, developed by the Tencent Hy Team. Following the Hy3 Preview launch in late April, we gathered feedback from 50+ products and scaled up post-training with higher quality data. Today, we introduce Hy3, which outper...



