API · OpenAI-compatible endpoint

GPT-6: Astra API and quickstart

The GPT-6: Astra API is called with the model identifier gpt-6-astra against OneInfer's OpenAI-compatible endpoint. It accepts text and image input and returns text, supports streaming, function calling, structured outputs, batch and caching, and allows up to 128,000 output tokens per response.

Python quickstart

Pass gpt-6-astra as the model identifier against the OneInfer OpenAI-compatible endpoint, with your OneInfer API key in the Authorization header.

Example
from openai import OpenAI

client = OpenAI(
    base_url="https://api.oneinfer.ai/v1",
    api_key="$ONEINFER_API_KEY",
)

response = client.chat.completions.create(
    model="gpt-6-astra",
    messages=[
        {"role": "user", "content": "Summarise the launch announcement in three bullets."},
    ],
    max_tokens=1024,
)
print(response.choices[0].message.content)

TypeScript quickstart

Example
import OpenAI from "openai";

const client = new OpenAI({
  baseURL: "https://api.oneinfer.ai/v1",
  apiKey: process.env.ONEINFER_API_KEY!,
});

const response = await client.chat.completions.create({
  model: "gpt-6-astra",
  messages: [{ role: "user", content: "Refactor this module for clarity." }],
  max_tokens: 2048,
});
console.log(response.choices[0].message.content);

cURL quickstart

Example
curl https://api.oneinfer.ai/v1/chat/completions \
  -H "Authorization: Bearer $ONEINFER_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "gpt-6-astra",
    "messages": [{"role": "user", "content": "Explain prompt caching in 100 words."}],
    "max_tokens": 1024,
    "stream": false
  }'

Ready to test the workflow?

Create account & add credits

Rate limits by tier

Rate limits scale by account tier, in requests per minute (RPM) and tokens per minute (TPM).

TierRPMTPM
Tier 1500500,000
Tier 25,0001,000,000
Tier 35,0002,000,000
Tier 410,0004,000,000
Tier 515,00040,000,000

What is not supported

GPT-6: Astra is not fine-tunable, accepts text and image input only (no audio or video input), and returns text only (no image, audio, or video output).

Frequently asked questions

How do you call GPT-6: Astra from Python?

Pass gpt-6-astra as the model identifier against the OneInfer OpenAI-compatible endpoint, with your OneInfer API key in the Authorization header. The request body is unchanged from any other chat-completions call.

What are GPT-6: Astra's rate limits?

Rate limits scale by account tier: Tier 1 is 500 RPM / 500K TPM, Tier 2 is 5,000 RPM / 1M TPM, Tier 3 is 5,000 RPM / 2M TPM, Tier 4 is 10,000 RPM / 4M TPM, and Tier 5 is 15,000 RPM / 40M TPM.

Can GPT-6: Astra be fine-tuned?

No, GPT-6: Astra does not support fine-tuning.

Put GPT-6: Astra to work

Fund a controlled evaluation, start with a prepared prompt, and measure quality and cost on your own workload.