OpenAI ditches Nvidia for faster AI inference chips, threatening chipmaker's dominance

Nvidia remains dominant in chips for training large AI models, while inference has become a new front in the competition.

The New Frontier Of LLM Inference: Where The Next Tenfold Gains Will Come From

This brute-force scaling approach is slowly fading and giving way to innovations in inference engines rooted in core computer ...
TMCnet

Nokia Strengthens Edge AI Capabilities Through Strategic Collaboration with Blaize on Hybrid Inference Solutions Across Asia Pacific Regions

Under the MOU, Blaize and Nokia intend to collaborate on: ...
VentureBeat

How Snowflake's open-source text-to-SQL and Arctic inference models solve enterprise AI's two biggest deployment headaches

Snowflake has thousands of enterprise customers who use the company's data and AI technologies. Though many issues with generative AI are solved, there is still lots of room for improvement. Two such ...
VentureBeat

How Cerebras is breaking the GPU bottleneck on AI inference

Nvidia has long dominated the market in compute hardware for AI with its graphics processing units (GPUs). However, the Spring 2024 launch of Cerebras Systems’ mature third-generation chip, based on ...
InfoWorld

Evolving Kubernetes for generative AI inference

Kubernetes has become the leading platform for deploying cloud-native applications and microservices, backed by an extensive community and comprehensive feature set for managing distributed systems.