Former Google researchers founded Sakana AI to focus on creating new architectures for the underlying model

CTOnews.com, Aug. 20 (Reuters)-two prominent former Google researchers, David Ha and Llion Jones, launched a research project on a new Tokyo-based artificial intelligence company and founded Sakana AI.

CTOnews.com learned from the report that Jones was the fifth author of Google's 2017 research paper "Attention Is All You Need", which introduced the "transformer" deep learning architecture, which later became the basis of the chatbot ChatGPT and the current product development competition driven by generative AI. Ha previously served as Stability AI's research director and Google Brain researcher.

Jones said Sakana AI would focus on creating a new architecture for the underlying model. "our approach is not to build a huge model that absorbs all the data, but to use a large number of smaller models, each with its own unique advantages and smaller data sets, and to communicate and collaborate with each other to solve problems." Ha explained.

The name Sakana comes from the Japanese word "fish fish" (sa-ka-na), which aims to evoke the idea that "schools of fish come together to form a coherent entity through simple rules", according to the two co-founders.