Tag: architecture

  • The Open Model Bet Got Bigger

    The Open Model Bet Got Bigger

    Thinking Machines Lab, the research group founded by Mira Murati after she left OpenAI, just released Inkling. It is a 975 billion-parameter open-weights model that you can download, run, and modify yourself. The architecture is sparse. Only 41 billion parameters activate per token, which means it runs fast and cheap despite the enormous size. The…