本ページの本文は英語で提供されています。タイトルと導入は日本語化されています。
これは何か
ERNIE is Baidu’s large language model series; the earliest, ERNIE 1.0, was released in March 2019 and stands for Enhanced Representation through Knowledge Integration. Its key idea is knowledge-enhanced pretraining: entity- and phrase-level masking during pretraining forces the model to learn knowledge relations between words, not just surface co-occurrence of neighbouring characters. The ERNIE line later grew into a large family spanning retrieval, dialogue and multimodality, and underpins Baidu’s ERNIE Bot product. This entry records the ERNIE starting point as represented by the early 2019 versions.
なぜ覚えておく価値があるか
It introduced entity- and phrase-level masking into pretraining so the model learns knowledge relations rather than mere character co-occurrence — an idea widely borrowed in early Chinese pretraining. These early versions have since been superseded by later ERNIE generations.
主な仕様
- Architecture
- Knowledge-enhanced pretraining (knowledge masking)
- Released
- 2019-03 (ERNIE 1.0)
- Modality
- Text
- Open weights
- No
対応する能力
関連する概念
同種の製品
GLM
2023自己回帰空白穴埋め事前学習から始まった中国語の汎用モデル
Qwen
2023多様な規模とマルチモーダル版を備えたオープンウェイトのモデル群
Hunyuan
2023開放ウェイト版を含むテンセントの汎用モデル群
Baichuan
2023中国語シーンに向けたオープンウェイトの汎用モデル
Doubao
2023バイトダンスの汎用対話モデルとアプリ
Pangu
2020華為の盤古シリーズ基盤モデル