OpenAI and Broadcom are pulling AI economics in-house article image

OpenAI and Broadcom are pulling AI economics in-house

OpenAI and Broadcom said on June 24 that they are building Jalapeño, OpenAI's first Intelligence Processor, for LLM inference. That is the part that matters. It is OpenAI pushing deeper into the infrastructure underneath ChatGPT, Codex, and the API.

OpenAI said the chip is "to be deployed at gigawatt scale with data center partners, over multiple generations." That is not startup language. That is utility-scale language. It tells me the company is thinking about power, racks, networking, and capital like a real infrastructure business.

The quote that stands out is Greg Brockman's: "The world is moving to a compute-powered economy." He is right. Once compute becomes the bottleneck, the winner is the company that can deliver enough intelligence at a cost customers will actually pay for.

Broadcom's framing is just as telling. Hock Tan said, "This is just the beginning of a multi-generation roadmap." That sounds like a company expecting a long run of demand, not a one-off custom order. The economics of AI are moving from renting compute to owning more of the stack underneath it.

Free HubSpot workshopBring one HubSpot problem to a free 30-minute callA screen-share walkthrough of your portal with me, not a salesperson, and a short roadmap at the end. No contract or credit card.Book the free workshop
OpenAI and Broadcom are pulling AI economics in-house
The AI business is moving closer to the hardware and data center layer underneath the models.

That matters because inference is where AI meets customers. Training gets the headlines. Inference is where the bills show up. If OpenAI can lower serving cost, it gets more room to price products, absorb demand spikes, and keep expanding without leaning quite so hard on someone else's hardware roadmap.

I also think this says something about where the market is headed. The companies with the biggest AI ambitions are no longer satisfied with being app layer buyers. They want control over chips, networking, data centers, and the software that ties all of it together. That is vertical integration with a very modern label on it.

This is a business story first and a chip story second. The chip is proof that the AI race is now about cost structure, supply chain control, and how much of the stack a company can own before the economics get too crowded.

OpenAI and Broadcom are pulling AI economics in-house supporting image
Own more of the stack and you own more of the economics.
Sam C BarthKnow what the tools cost before the invoice doesI help teams sort out HubSpot, CRM, and RevOps so spend lines up with the work it supports.Visit samcbarth.com