Introduction Groq - world's fastest AI inference

Learn how Groq's LPU hardware and software platform provides high‑speed, energy‑efficient AI inference, offers free cloud compute for testing, and supports on‑prem deployment for production.

Overview

Groq builds fast AI inference technology. Groq® LPU™ AI inference technology is a hardware and software platform that delivers exceptional AI compute speed, quality, and energy efficiency. Groq, headquartered in Silicon Valley, provides cloud access to popular models, via the GroqCloud, and on-prem solutions at scale for AI applications. The LPU and related systems are designed and manufactured in North America.

Links

https://www.groq.com
Groq provides low-latency AI inference utilizing custom LPU architecture.

Tech stack