Skip to main content
POST

Authorizations

Authorization
string
header
required

Bearer authentication header of the form Bearer <token>, where <token> is your auth token.

Body

application/json
modelPreset
enum<string>

Model Preset

Available options:
custom,
gpt2-124m,
llama-3-2-1b,
llama-3-2-3b,
mistral-7b,
llama-3-8b,
llama-2-13b,
mixtral-8x7b,
llama-3-70b,
llama-3-1-405b
params
number

Parameters (B)

Required range: 0.001 <= x <= 2000
hiddenDim
number

Hidden Dim

Required range: 64 <= x <= 65536
layers
number

Layers

Required range: 1 <= x <= 256
mode
enum<string>

Workload

Available options:
inference,
training
precision
enum<string>

Precision

Available options:
fp32,
fp16,
int8,
int4
batchSize
number

Batch Size

Required range: 1 <= x <= 4096
seqLen
number

Sequence Length

Required range: 1 <= x <= 1048576
optimizer
enum<string>

Optimizer

Available options:
adam,
sgd-momentum,
sgd
mixedPrecision
boolean

Mixed precision (fp32 master weights + grads)

gradCheckpoint
boolean

Gradient checkpointing (recompute activations)

Response

Tool output

outputs
object
required
tool
string
required

The tool's slug, echoing the {slug} in the request path.

tool_version
string
required

Output-contract version for this tool.

credits_used
integer
required

Credits this call consumed, after any settlement refund. 0 when metering is disabled.

credits_remaining
integer | null
required

Credits left in the current monthly allowance, or null when metering is disabled.

request_id
string

Correlation id, also sent as x-request-id.