24c0b83803ff4ac8b32693aee54098e8

deepseek/deepseek-r1-distill-llama-8b

deepseek/deepseek-r1-distill-llama-8b
Context

32K

Input

text

Output

text

Tool calling

Supported

About this model

DeepSeek-R1-Distill-Llama-8B combines DeepSeek-R1 knowledge distillation with Llama architecture. Available in FP8 (H100+ only) and FP16 quantization, delivering efficient performance with 32K context.

Compare Text Models

Input modalities

text

Accepted as model input

Providers

Available routing options for this model through OneInfer.

24c0b83803ff4ac8b32693aee54098e8
Available

Routing

OneInfer optimized

Pricing

Current OneInfer pricing for this model.

UsagePrice

Performance

Published evaluation results associated with this model.

Performance

MMLU71.5
GSM8K82.3
HumanEval61.4
Tokens/sec (A100)110

API example

Refer Documentation
curl https://api.oneinfer.ai/v1/ula/chat/completions \
  -H "Authorization: Bearer $JWT_TOKEN" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "deepseek/deepseek-r1-distill-llama-8b",
    "messages": [
      { "role": "user", "content": "Hello!" }
    ]
  }'