Baichuan Intelligence launched the Baichuan2-19K model, and the context window is about 14 times longer than GPT-4.

CTOnews.com October 30 news, Baichuan Intelligent today announced the launch of the Baichuan2-19K model. According to reports, the context window of the model is 192 K in length and can handle about 350000 Chinese characters. It is claimed to be the longest context window in the world.

According to Baichuan Intelligence, Baichuan2-19K is 4.4 times of Claude2 (100K context window, about 80,000 words), and 14 times of GPT-4 (32K context window, about 25000 words).

CTOnews.com Note: context window length is one of the core technologies of large models. Through larger context windows, the model can combine more context content to obtain richer semantic information, better capture context relevance, eliminate ambiguity, and then generate content more accurately and fluently, and improve the ability of the model.

Baichuan2-19K performed well in the evaluation set of 10 questions, answers and abstracts in Chinese and English long texts, such as Dureader, NarrativeQA, LSHT, TriviaQA, etc., and got SOTA in 7 items.

Baichuan Intelligent said that Baichuan2-19K will be made available to corporate users through API calls and privatized deployment. At present, Baichuan Intelligent has launched API internal testing of Baichuan2-19K, which is open to core partners in the legal, media, financial and other industries.