Alpha.sh
Sign in Get an API key
Backed by HF0

The performance layer
for open intelligence.

Run open-weight models at frontier performance for enterprise deployments. 99.9% uptime and p99 latency in the contract, on capacity reserved for you.

Get an API key Talk to an engineer

OpenAI-compatible · one base URL change · zero retention

The Alpha.sh Platform

A unified inference platform for high-performance, portable compute, enabling full optimizations from GPU kernel to API endpoint.

2× faster than generic serving

One codebase from GPU kernel to API endpoint, so every layer is tuned for the one below it. Text, image and video pipelines, no glue code.

AI across GPUs, CPUs and ASICs

Same model, same codebase, running on NVIDIA, AMD, arm, Intel, TPU and Trainium. Switch hardware without touching your application.

50% lower cost at scale

Higher GPU utilization, faster runtime and hardware chosen per workload. Against generic serving on the same models, savings compound with volume.

A B α 1m tok 5m tok 10m tok

One coherent stack, from your request to the GPU

Most inference is assembled from parts that were never designed to hold an SLA together. Alpha.sh runs every layer, so the contract can cover all of them.

  • GatewayAdmits each request against its deadline, refuses what it cannot finish
  • OrchestrationDeployments, rollouts and capacity changes, with no downtime
  • ServingFrontier open models, scheduled for your p99, not average latency
  • Cache & transportReuses shared prefixes and moves context between GPUs
  • Trust & telemetryVerified nodes, SLA metrics exported to your stack
  • HardwareReserved GPU pools with headroom for your peak, our cloud or yours

Fast inference, deployed your way

Run leading open models or your own custom models in our managed cloud, in your VPC or fully self-hosted.

Inference solutions

Shared endpoints

High-performance inference on multi-tenant pools. No infrastructure to manage, no long-term commitment. Per-token pricing.

Dedicated endpoints

Reserved GPUs across vendors, isolated to your organization, with the full SLA. Per-minute pricing.

Custom models

Bring your own fine-tuned or custom models. Deployed on optimized infrastructure, in our cloud or your VPC.

Get started 
from openai import OpenAI

client = OpenAI(
    # the only change
    base_url="https://api.alpha.sh/v1",
    api_key="ALPHA_API_KEY",
)

completion = client.chat.completions.create(
    model="deepseek-v4-flash",
    messages=[
        {
          "role": "user",
          "content": "Summarize this."
        },
    ],
    extra_headers={
        "X-Alpha-Deadline": "800ms"
    },
)

print(completion.choices[0].message.content)

Deployment solutions

Our cloud

Fully managed by Alpha.sh. We hold the SLA and the security posture so you don't have to. Best token economics across heterogeneous hardware vendors.

Your cloud

Alpha.sh manages the control plane while inference runs in your VPC. You own the hardware, the data and the cloud credits.

Self-hosted

The Alpha.sh serving engine in a container on your own infrastructure. NVIDIA, AMD, arm, Intel, TPU and Trainium: your hardware, your cloud, your rules.

Built for enterprise workloads

The six questions every security, finance and platform review asks an inference vendor, answered with a document rather than a slide.

Reliability

99.9% uptime, p99 in the contract

Credits computed from our telemetry and applied automatically on the schedule in your agreement. You never file a claim.

SLA & credit schedule · on request
Data

Zero retention, region pinned

Prompts and completions are not stored. EU or US residency per endpoint, single-tenant pools on request, subprocessor list published.

Security & residency brief · on request
Observability

Every request measured, every metric exported

Latency, uptime and SLA outcome per endpoint in the console, exported over OpenTelemetry to your own stack. Breaches are computed from those numbers.

Metrics & export guide · on request
Lock-in

One line to adopt, one line to leave

OpenAI-compatible request and response shapes. Keep your router; send us the traffic that cannot fail.

Migration guide · on request
Cost

Same weights, smaller invoice

Savings come from deadline scheduling and utilization, not from swapping in a compressed copy. When we quantize, the endpoint says so, next to published evals.

Pricing · on request
Capacity

Reserved, with headroom for your peak

Capacity is pre-committed against your contract. No spot, no silent fallback to another provider's build.

Reserve capacity · on request

What you get

Frontier performance

Open-weight models now match closed APIs on the public intelligence index.

60× lower cost than closed APIs

The same index score at a fraction of the price, on your own dedicated endpoint.

Your data stays yours

Zero retention, region pinned, 99.9% uptime and p99 latency in the contract.

Closed API · Claude Opus 4.8before
$1.80
Public open endpoint · DeepSeek V4 Flashbefore
$0.03
Shared infrastructure · no SLA
Alpha.sh · DeepSeek V4 Flash, dedicatedafter
$0.03 or lower
Zero retention · 99.9% SLA in the contract
$ per 1M output tokens · Artificial Analysis Intelligence Index v4.1.1

Get started
with Alpha.sh

Frontier open models at 60× lower cost, with the SLA and data control your enterprise requires.

Request a demo

A custom end-to-end deployment built around your models, hardware and performance goals.

  • Dedicated endpoints with 99.9% uptime and p99 in the contract
  • Frontier performance at a fraction of closed-API cost
  • Deploy in Alpha.sh cloud, your VPC or self-hosted
  • Evaluate with your own workloads, no commitment
Book a demoTalk with our engineering team
30 min · your workloads · ask us anything