AI compute company Cerebras Systems today announced what it said is the fastest AI inference solution. Cerebras Inference delivers 1,800 tokens per second for Llama3.1 8B and 450 tokens per second for ...

As demand for open-source AI infrastructure grows, Novita AI is establishing itself as the inference provider for developers and engineering teams that need fast and affordable inference for ...

Ambitious artificial intelligence computing startup Cerebras Systems Inc. is raising the stakes in its battle against Nvidia Corp., launching what it says is the world’s fastest AI inference service, ...

SUNNYVALE, Calif.--(BUSINESS WIRE)--Meta has teamed up with Cerebras to offer ultra-fast inference in its new Llama API, bringing together the world’s most popular open-source models, Llama, with the ...

20X performance and 1/5th the price of GPUs- available today Developers can now leverage the power of wafer-scale compute for AI inference via a simple API SUNNYVALE, Calif.--(BUSINESS ...

Google Research unveiled TurboQuant, a novel quantization algorithm that compresses large language models’ Key-Value caches ...

When it's all abstracted by an API endpoint, do you even care what's behind the curtain? Comment With the exception of custom cloud silicon, like Google's TPUs or Amazon's Trainium ASICs, the vast ...

Artificial intelligence inference startup Simplismart, officially known as Verute Technologies Pvt Ltd., said today it has closed on $7 million in funding to build out its infrastructure platform and ...

Fastest inference coming soon: AWS and Cerebras are partnering to deliver the fastest AI inference available through Amazon Bedrock, launching in the next couple of months. Industry-leading speed and ...

Startup launches “Corsair” AI platform with Digital In-Memory Computing, using on-chip SRAM memory that can produce 30,000 tokens/second at 2 ms/token latency for Llama3 70B in a single rack. Using ...

It all started because I heard great things about Kimi K2 (the latest open-source model by Chinese lab Moonshot AI) and its performance with agentic tool calls. The folks at Moonshot AI specifically ...