Tag: silicon
-

OpenAI and Broadcom’s Custom Chip Just Cut Costs in Half
OpenAI and Broadcom just showed you what the next competitive frontier looks like. They announced Jalapeno, a custom inference chip designed specifically to run large language models, and it cuts the cost per token by roughly 50 percent compared to Nvidia GPUs. Custom silicon is not new. What is new is that OpenAI is moving…
