Moreh and SGLang Showcase Distributed Inference System on AMD

Sep 12, 2025
Moreh has unveiled its distributed inference system on AMD at the AI Infra Summit 2025, showcasing collaborations with Tenstorrent and SGLang.

Moreh has unveiled its distributed inference system on AMD at the AI Infra Summit 2025, showcasing collaborations with Tenstorrent and SGLang announced in a press release. The event, held in Santa Clara from September 9 to 11, featured Moreh's CEO Gangwon Jo presenting benchmark results that demonstrated the system's efficiency in optimizing deep learning models like DeepSeek, surpassing NVIDIA's performance.

Additionally, Moreh introduced a next-generation AI semiconductor system that combines its software with Tenstorrent's hardware. The company co-hosted a presentation with SGLang and organized networking sessions to further discuss their joint development of an AMD-based distributed inference system. This collaboration aims to accelerate the expansion of the deep learning inference market.

We hope you enjoyed this article

Consider subscribing to one of our newsletters like Silicon Brief or Daily AI Brief.

Also, consider following us on social media:

AI Chips & Datacenters AI Brief AI Brief (X)
Free newsletter

Silicon Brief

Weekly coverage of AI hardware developments including chips, GPUs, cloud platforms, and data center technology.

AI Token Webinar

Industry analysis

2025 Global Business Services Agenda: Gen AI Takes Center Stage

The Hackett Group

This industry analysis by The Hackett Group explores the transformative impact of generative artificial intelligence (Gen AI) on global business services (GBS) in 2025. The study highlights the shift from exploration to acceleration of Gen AI initiatives, with 89% of executives advancing these projects to improve customer satisfaction, innovate products, and reduce costs. The report also discusses the challenges and strategies for successful Gen AI adoption, emphasizing the need for a technology-enabled operating model and the importance of reskilling the workforce.

Read more

You may also like

Free, six days a week

Daily AI Brief: the AI news that matters, in your inbox.