google.com, pub-8612160310098011, DIRECT, f08c47fec0942fa0

AMD admits its Instinct MI300X AI accelerator still cant quite beat Nvidias H100 Hopper


On Wednesday, AMD released benchmarks comparing the performance of its MI300X with Nvidia’s H100 GPU to showcase its Gen AI inference capabilities. For the LLama2-70B model, a system with eight Instinct MI300X processors reached a throughput of 21,028 tokens per second in server mode and 23,514 tokens per second in…

Read Entire Article

Comments Closed

Comments are closed.

Copyright © No More Traffic