Muna logomuna

Our compiled models.
Your AI client.

We help AI teams run inference with open models, with a focus on boosting GPU utilization so that they serve more and spend less.

Each model is compiled into a self-contained binary and served by an inference runtime we wrote to pack GPUs: several models co-located on a single GPU (megakernel style), with optimizations up and down the stack.

As a result, tokens cost about 40% less here than on OpenRouter, behind the OpenAI and Anthropic APIs you already use.

Quick start

Point the OpenAI SDK at https://inference.muna.ai/v1, or the Anthropic SDK at https://inference.muna.ai, and call any model below.

Get your API key
from openai import OpenAI


# 💥 Create an OpenAI client with the Muna URL
openai = OpenAI(
    base_url="https://inference.muna.ai/v1",
    api_key="<your Muna API key>"
)


# 🔥 Create a chat completion
completion = openai.chat.completions.create(
    model="@fxn/greeting",
    messages=[{ "role": "user", "content": "What is a GPU?" }]
)


# 🚀 Print the output
print(completion.choices[0].message.content)

Models

ModelKindPrice
@fxn/greeting
Say a friendly greeting!
chat
$3.00
in / 1M
$15.00
out / 1M
@deepseek/deepseek-v4-flash
Fast MoE chat model.Coming soon
chat—
@zai/glm-5.3-flash
Fast chat model from Z.ai.Coming soon
chat—

Need a model that is not here? Ask; bringing one up takes days, not quarters.

How it works

96 MB
compiled Gemma 4 26B binary; the SGLang container is 25.8 GB
6.0 s
cold start to first token
18×
faster cold start than SGLang

It all starts with a Python function. Muna compiles this into a self-contained binary, instead of running a container. The result is a hundred megabytes of code that reads weights off disk and starts serving in seconds.

Because we can spin up a model so quickly, our runtime can load models on demand; co-locate multiple models; and evict when idle. As such, a GPU-hour serves more tokens and the price per token drops.

Cold start to first token · Gemma 4 26B

loading…

Full report with raw data · Methodology