OpenAI’s Jalapeño chip is built for fast inference at scale, benchmarks show
Tested on SemiAnalysis’ InferenceX benchmark, Jalapeño registered both more tokens per user and more throughput per kilowatt than the currently available state of the art.
Russell Brandom科技新星日报
1 分钟阅读0 阅读
Tested on SemiAnalysis’ InferenceX benchmark, Jalapeño registered both more tokens per user and more throughput per kilowatt than the currently available state-of-the art.
Source: TechCrunch AI — fetched automatically.