Welcome China Products Info!
loading
Release Info
    Categories
    China Products Info > 热点资讯 > China News >  Baidu Open-Sources ERNIE 5.5 Flash Base: MoE With 280B Parameters, 1M-Token Context

    Baidu Open-Sources ERNIE 5.5 Flash Base: MoE With 280B Parameters, 1M-Token Context

    时间:2026-11-06 11:08:39  编辑:graysky  来源:Xinhua / Baidu, Nov 5, 2026  浏览:1次   【大】【中】【小】 网站投稿
    Baidu officially open-sourced its latest base model ERNIE 5.5 Flash Base on November 5. Built on a Mixture-of-Experts architecture with 280 billion total parameters and 1…

    Baidu officially open-sourced its latest base model ERNIE 5.5 Flash Base on November 5. Built on a Mixture-of-Experts architecture with 280 billion total parameters and 14 billion activated per token, it was pre-trained on 33.5 trillion tokens with a 128K pre-training context and up to 1 million tokens during fine-tuning and inference. Emphasizing efficiency, it introduces Latent-Gated Sparse Attention, Multi-Router Latent MoE and an ECHO training objective, and posted state-of-the-art results among same-size models on knowledge, reasoning, math, code and long-context benchmarks. The model is available on Hugging Face.

    Source: Xinhua / Baidu, Nov 5, 2026 | 2026-11-05

    13775048177