Elon Musk announced the formation of what he’s calling xAI, whose goal is to “understand the true nature of the universe.” The team at xAI, led by Musk, includes individuals who have previously worked at DeepMind, OpenAI, Google Research, Microsoft Research, Tesla, and the University of Toronto.
“Collectively we contributed some of the most widely used methods in the field, in particular the Adam optimizer, Batch Normalization, Layer Normalization, and the discovery of adversarial examples. We further introduced innovative techniques and analyses such as Transformer-XL, Autoformalization, the Memorizing Transformer, Batch Size Scaling, and uTransfer. We have worked on and led the development of some of the largest breakthroughs in the field including AlphaStar, AlphaCode, Inception, Minerva, GPT-3.5, and GPT-4,” xAI said in a blog post.
Read more of this story at Slashdot.