Challenging Nvidia: The Rise of AI Inference Chips and a Shifting Microchip Landscape

Nvidia rivals focus on building a different kind of chip to power AI products

The need for graphic processor chips has led rivals to think they can compete with Nvidia in selling so-called AI inference chips that are more attuned to the day-to-day running of AI tools and designed to reduce some of the huge computing costs of generative AI.

That's led startups like Cerebras, Groq and d-Matrix as well as Nvidia's traditional chipmaking rivals — such as AMD and Intel — to pitch more inference-friendly chips as Nvidia focuses on meeting the huge demand from bigger tech companies for its higher-end hardware.

Does this pose a real threat to Nvidia and change in the dynamics in the microchips industry? Only time will tell.