Ernie Bot (Chinese: 文心一言, Pinyin: wénxīn yīyán), full name Enhanced Representation through Knowledge Integration,[1] is an AI chatbot service product of Baidu, released in 2023. It is built on a large language model called ERNIE, which has been in development since 2019. The latest version, ERNIE 4.0, was announced on October 17, 2023.[2]
History
Ernie Bot was initially released for invited testing on March 16, 2023, based on "Ernie 3.0", a large language model that had been in development since 2019.[3][4] Ernie's so-called live release demo was reported to have been prerecorded, which caused Baidu's stock to drop 10 percent the same day.[5] The company's stock gained 14 percent on the next day after analysts from Citigroup and Bank of America tested Ernie Bot and gave it a preliminary thumbs-up.[6]
Ernie Bot was released to the public after receiving the green light from Chinese regulatory authorities on August 31, 2023.[7]
"Ernie 3.0", the language model, was trained with 10 billion parameters on a 4 terabyte (TB) corpus which consists of plain texts and a large-scale knowledge graph.[8] It was then updated to "Ernie 3.5" in June 2023, but it was "slightly inferior" to Open AI's GPT-4.[9] As a response, "Ernie 4.0" was unveiled in October and was released for paying subscribers in November of the same year.[10]
Baidu claimed that Ernie bot received more than 100 million users as of December 2023.[11][12] Ernie Bot's accumulated user base grew to 200 million as April 2024.[13]
In January 2024, Hong Kong newspaper South China Morning Post reported that a university research lab linked to the People's Liberation Army (PLA) had tested Ernie Bot and iFlyTek's Spark for military response plans with scenarios involving the United States. After its listed stock in Hong Kong plunged by more than 11.5 percent, Baidu made an official statement denying the allegations.[11]
In June 2024, Baidu announced that Ernie Bot had reached 300 million users. The company also unveiled its latest foundation model, Ernie 4.0 Turbo, which boasts faster response times and improved performance.[16]
In September 2024, Baidu gave everyone using the app access to the 4.0 Turbo model and also announced it would change its Chinese name from "Wenxin Yiyan" (文心一言) to "Wenxiaoyan" (文小言) positioning itself as a search assistant.[17][18]
Training
Ernie Bot is based on particular Ernie foundation models, including Ernie 3.0, Ernie 3.5, and Ernie 4.0. The training process starts from pre-training, learning from trillions of data points and billions of knowledge pieces. This was followed by refinement through supervised fine-tuning, reinforcement learning with human feedback, and prompt.[19]
Service
In its subscription options, the professional plan gives users access to Ernie 4.0 with a payment either for a month or with reduced payment for auto-renewal per month. Meanwhile, Ernie 3.5 is free of charge.[20]
Ernie 4.0, the language model for Ernie bot, has information updated to April 2023.[10]
^ abc"Meet Ernie, China's answer to ChatGPT". The Economist. 3 September 2023. ISSN0013-0613. Archived from the original on 2023-09-03. Retrieved 2023-09-03. On matters of politics, by contrast, the chatbot is rather quiet. Ernie is confused by questions such as "Who is China's president?" and will tell you the name of Xi Jinping's mother, but not those of his siblings. It draws a blank if asked about the drawbacks of socialism. It often attempts to redirect sensitive conversations by saying: "Let's talk about something else." Ernie's reticence will come as no shock to Chinese users familiar with a heavily censored internet.
^Feng, Emily (May 29, 2024). "Why China, and now Taiwan, are making their own chatbots using their own data". NPR. Retrieved May 29, 2024. ERNIE, developed by Chinese internet company Baidu. But ERNIE has to follow Chinese censorship rules and political mores, including, for example, saying in answers that Taiwan is part of China - because only training a model on data from China could make a pro-China LLM.