xAI has opened sourced its large language model Grok. From a report: The move, which Musk had previously proclaimed would happen this week, now enables any other entrepreneur, programmer, company, or individual to take Grok’s weights — the strength of connections between the model’s artificial “neurons,” or software modules that allow the model to make decisions and accept inputs and provide outputs in the form of text — and other associated documentation and use a copy of the model for whatever they’d like, including for commercial applications.
“We are releasing the base model weights and network architecture of Grok-1, our large language model,” the company announced in a blog post. “Grok-1 is a 314 billion parameter Mixture-of-Experts model trained from scratch by xAI.” Those interested can download the code for Grok on its Github page or via a torrent link. Parameters refers to the weights and biases that govern the