Groq AI Chip Benchmarks Leading Performance on ResNet-50 Inference

Today AI chip startup Groq announced that their new Tensor processor has achieved 21,700 inferences per second (IPS) for ResNet-50 v2 inference. Groq's level of inference performance exceeds that of other commercially available neural network architectures, with throughput that more than doubles the ResNet-50 score of the incumbent GPU-based architecture. ResNet-50 is an inference benchmark for image classification and is often used as a standard for measuring performance of machine learning accelerators.

The post Groq AI Chip Benchmarks Leading Performance on ResNet-50 Inference appeared first on insideHPC.