Python quickstart
Pass gpt-6-astra as the model identifier against the OneInfer OpenAI-compatible endpoint, with your OneInfer API key in the Authorization header.
from openai import OpenAI
client = OpenAI(
base_url="https://api.oneinfer.ai/v1",
api_key="$ONEINFER_API_KEY",
)
response = client.chat.completions.create(
model="gpt-6-astra",
messages=[
{"role": "user", "content": "Summarise the launch announcement in three bullets."},
],
max_tokens=1024,
)
print(response.choices[0].message.content)TypeScript quickstart
import OpenAI from "openai";
const client = new OpenAI({
baseURL: "https://api.oneinfer.ai/v1",
apiKey: process.env.ONEINFER_API_KEY!,
});
const response = await client.chat.completions.create({
model: "gpt-6-astra",
messages: [{ role: "user", content: "Refactor this module for clarity." }],
max_tokens: 2048,
});
console.log(response.choices[0].message.content);cURL quickstart
curl https://api.oneinfer.ai/v1/chat/completions \
-H "Authorization: Bearer $ONEINFER_API_KEY" \
-H "Content-Type: application/json" \
-d '{
"model": "gpt-6-astra",
"messages": [{"role": "user", "content": "Explain prompt caching in 100 words."}],
"max_tokens": 1024,
"stream": false
}'Ready to test the workflow?
Create account & add creditsRate limits by tier
Rate limits scale by account tier, in requests per minute (RPM) and tokens per minute (TPM).
| Tier | RPM | TPM |
|---|---|---|
| Tier 1 | 500 | 500,000 |
| Tier 2 | 5,000 | 1,000,000 |
| Tier 3 | 5,000 | 2,000,000 |
| Tier 4 | 10,000 | 4,000,000 |
| Tier 5 | 15,000 | 40,000,000 |
What is not supported
GPT-6: Astra is not fine-tunable, accepts text and image input only (no audio or video input), and returns text only (no image, audio, or video output).
Frequently asked questions
How do you call GPT-6: Astra from Python?
Pass gpt-6-astra as the model identifier against the OneInfer OpenAI-compatible endpoint, with your OneInfer API key in the Authorization header. The request body is unchanged from any other chat-completions call.
What are GPT-6: Astra's rate limits?
Rate limits scale by account tier: Tier 1 is 500 RPM / 500K TPM, Tier 2 is 5,000 RPM / 1M TPM, Tier 3 is 5,000 RPM / 2M TPM, Tier 4 is 10,000 RPM / 4M TPM, and Tier 5 is 15,000 RPM / 40M TPM.
Can GPT-6: Astra be fine-tuned?
No, GPT-6: Astra does not support fine-tuning.
Put GPT-6: Astra to work
Fund a controlled evaluation, start with a prepared prompt, and measure quality and cost on your own workload.