OpenAI and Broadcom Introduce Custom AI Chip for LLM Inference

OpenAI and Broadcom have collaborated to create 'Jalapeño,' a custom AI chip designed for Large Language Model inference. This new chip reportedly offers significant cost savings, around 50% compared to standard AI GPUs, while matching the performance of leading chips from Nvidia and Google. Full deployment of the chip is anticipated by the end of 2026.