Groq’s breakthrough AI chip achieves blistering 800 tokens per second on Meta’s LLaMA 3
VentureBeat -

Groq Inc's AI chip delivers blistering 800 tokens/sec inference on Meta's LLaMA 3 model, potentially reshaping the landscape of AI hardware.

In related news