Kev
kev-4b86ms
Warm p50 · L40S GPU1
- Base model
- Qwen3.5 4B
- Context per question
- 12,288 tokens
- Question types
- noul, choice, score2
Try open decision models via simple API call. Decider handles the hosting and pays for the GPU.
Best-effort availability. Contact me about self-hosting on your own compute or the serving layer behind this API.
“Our payment service has been down for three hours.”
Is this urgent?noul
Which team should handle this?choice
Sample answers. Two questions, one request.
Choose Kev or Strands, send context and questions, and get probabilities, choices, or scores.
curl https://api.decider.cloud/v1/systemone \
-H 'Content-Type: application/json' \
-d '{
"model": "kev-4b",
"state": "Our payment service has been down for three hours.",
"questions": {
"urgent": {
"type": "noul",
"instructions": "Is this urgent?"
}
}
}'{
"model": "kev-4b",
"answers": {
"urgent": {
"type": "noul",
"noul": 0.68235
}
},
"usage": {
"input_tokens": 23,
"output_tokens": 19
},
"latency_ms": 143.59
}Cold starts: The API scales to zero when idle. Your first request after inactivity can take about 30 seconds while models load.
kev-4b86ms
Warm p50 · L40S GPU1
strands-decider-2b45ms
Warm p50 · L40S GPU1
Latency. Median of sample warm requests. Includes input processing and inference; excludes network time and cold starts.
Shared limits. Both models take up to 8 questions per request and 255 options per choice.
Many problems need structured decisions, not generated prose or code. Decision models can return structured answers in real time, at low inference cost, without task-specific training.
Scroll to compare all approaches
| Requirement | Rule engine | ML classifier | LLM | Decision models |
|---|---|---|---|---|
| InputNatural language context and questions | × | △ | ✓ | ✓ |
| OutputBounded choices and confidence | ✓ | ✓ | △ | ✓ |
| GeneralizationPrompt it; no task training | × | × | ✓ | ✓ |
| LatencyFast decisions in the request path | ✓ | ✓ | △ | ✓ |
| CostLow inference cost at scale | ✓ | ✓ | △ | ✓ |
Decider makes open decision models easier to evaluate through a shared API. Try different models on your own examples before choosing one. Kev and Strands are available today.
Yes, during the public preview. No API key is required. I set up the serving infra and pay for the GPU so you don't have to. The preview has a fixed compute budget and can change or end. Availability is best effort; use it for research and evaluation.
Decider follows the TypeSafe SystemOne request and answer shapes. Change the endpoint and select a supported model. See the compatibility notes for details.
The service scales to zero while idle. Loading the models can take about 30 seconds. The warm model medians above exclude that startup and network time.
One inference runs at a time across all users and both models. A busy request returns 429 with Retry-After. Wait and retry. The public preview has no uptime guarantee.
The serving runtime never stores request content. Decider logs only model names and request timing. Use the preview for evaluation with nonconfidential inputs.
Jev is TypeSafe AI’s first public System One model for structured decisions. Decider hosts Kev and Strands independently. Read TypeSafe’s introduction.
It turns context and a question into a probability, choice, or score your software can use. Define the task and allowed answers in your request.
System One models make fast, structured decisions. System Two models use slower, deliberate reasoning. Learn about TypeSafe’s System One models.
LLMs generate text and can return structured data. Decision models focus on probabilities, choices, and scores. Use an LLM when you need writing or explanations.
Route tickets, classify content, prioritize incidents, or choose a workflow’s next step. They suit tasks with clear options or scoring criteria.
Yes. Structured answers can still be wrong. Test on your own data, set suitable thresholds, and use human review or fallbacks for consequential decisions.
Bring your own examples. Try the API free, no API key needed.
Need your own compute or guaranteed capacity? Message me on X about a private deployment.