Rebellions NPUs Get Official Support in llm-d Inference Framework

Oct 27, 2026
Rebellions NPUs are now officially supported in llm-d, the open-source framework for distributed LLM inference on Kubernetes.

South Korean chipmaker Rebellions said its NPUs are now officially supported in llm-d, the open-source framework for running distributed large language model inference on Kubernetes. According to the llm-d documentation, support comes through vllm-rbln, a vLLM platform plugin that ships in a public container image, so developers can add Rebellions NPUs to a standard vLLM setup without forking it.

Rebellions said the integration includes distributed inference features such as prefill/decode disaggregation. The llm-d reference setup serves OpenAI's gpt-oss-120b on two Rebellions NPUs, with devices allocated through Kubernetes dynamic resource allocation.

We hope you enjoyed this article

Consider subscribing to one of our newsletters like Silicon Brief or Daily AI Brief.

Also, consider following us on social media:

Free newsletter

Silicon Brief

Weekly coverage of AI hardware developments including chips, GPUs, cloud platforms, and data center technology.

Industry analysis

2025 Global Business Services Agenda: Gen AI Takes Center Stage

The Hackett Group

This industry analysis by The Hackett Group explores the transformative impact of generative artificial intelligence (Gen AI) on global business services (GBS) in 2025. The study highlights the shift from exploration to acceleration of Gen AI initiatives, with 89% of executives advancing these projects to improve customer satisfaction, innovate products, and reduce costs. The report also discusses the challenges and strategies for successful Gen AI adoption, emphasizing the need for a technology-enabled operating model and the importance of reskilling the workforce.

Read more
Free, six days a week

Daily AI Brief: the AI news that matters, in your inbox.