Rebellions NPUs Get Official Support in llm-d Inference Framework
South Korean chipmaker Rebellions said its NPUs are now officially supported in llm-d, the open-source framework for running distributed large language model inference on Kubernetes. According to the llm-d documentation, support comes through vllm-rbln, a vLLM platform plugin that ships in a public container image, so developers can add Rebellions NPUs to a standard vLLM setup without forking it.
Rebellions said the integration includes distributed inference features such as prefill/decode disaggregation. The llm-d reference setup serves OpenAI's gpt-oss-120b on two Rebellions NPUs, with devices allocated through Kubernetes dynamic resource allocation.
We hope you enjoyed this article
Consider subscribing to one of our newsletters like Silicon Brief or Daily AI Brief.
Also, consider following us on social media:
More from Data Centers
Oct 27 Spain Eases Proposed Rules for Data Centers Oct 27 General Compute Raises $100 Million for Non-Nvidia Inference Cloud Oct 27 Freedom Plans Kazakhstan GPU Cloud for 2027 Oct 27 Vertiv Completes $1.45 Billion UtilityInnovation Group Acquisition Oct 27 Bank Group Arranges $63 Billion for Anthropic AI ComputeSilicon Brief
Weekly coverage of AI hardware developments including chips, GPUs, cloud platforms, and data center technology.
Industry analysis
2025 Global Business Services Agenda: Gen AI Takes Center Stage
This industry analysis by The Hackett Group explores the transformative impact of generative artificial intelligence (Gen AI) on global business services (GBS) in 2025. The study highlights the shift from exploration to acceleration of Gen AI initiatives, with 89% of executives advancing these projects to improve customer satisfaction, innovate products, and reduce costs. The report also discusses the challenges and strategies for successful Gen AI adoption, emphasizing the need for a technology-enabled operating model and the importance of reskilling the workforce.
Read moreYou may also like
Liquid AI Releases LFM2.5-24B-A2B for Local AI Agents
Logic Fruit Unveils Reconfigurable BMC Platform for AI Servers
DeepSeek Open Sources DeepInfer Inference Framework
NVIDIA Details Nemotron 3.5 Super VL for Multimodal Agents
NVIDIA Partners Expand European AI Clouds and Agent Controls
Daily AI Brief: the AI news that matters, in your inbox.