Decide 9x faster than TypeSafe Jev 1.13, 33% cheaper
Ask a yes-or-no question of a message, a review or a comment: is it spam, is it negative. SIE, an open-source inference engine, serves DeBERTa v3 large zero-shot v2.0, a small open model that returns the probability of yes in one call: you state what yes means, with no training or fine-tuning.
SIE DeBERTa v3 large zero-shot v2.0
Yes: spamSIX chances to win CASH! From 100 to 20,000 pounds txt> CSH11 and send to 87575. Cost 150p/day, 6days, 16+ TsandCs apply Reply HL 4 info
This text message is spam.
TypeSafe Jev 1.13 keeps your app waiting 125 ms for each yes or no; GPT‑6 Luna, 884 ms
TypeSafe Jev 1.13
Over 100 msIs this comment on a music video spam? (with its rule for yes and no)
GPT-6 Luna (short)
Over 100 msIs this comment spam?
- Nielsen Norman Group Nielsen: a response feels instant only within 0.1 second
Response Times: The 3 Important Limits
0.1 second is about the limit for having the user feel that the system is reacting instantaneously.
- arXiv:2608.20371 Study: Claude Haiku 4.5 took 981 ms and $0.25 per 1,000 calls to label one request
When Do LLMs Replace Fine-Tuned NLU? A Decision Framework for Intent Detection in Production Conversational Systems
“the LLM’s median is 981 ms, with a p95 of 1,787 ms, above the 500 ms conversational bar.”
9x faster than TypeSafe Jev 1.13 33% cheaper, at 95% of its accuracy
- Tested
- 1,560 YouTube comments, spam or not: the hardest of 3 public test sets
- Scored
- Right when it matches the dataset's label, at a cut-off set on 396 labelled comments
- Prices
- TypeSafe, OpenAI and Anthropic list prices; SIE at its Serverless price
- Timing
- SIE timed on a GPU server with the client alongside; providers over their public APIs
State what yes means, get its probability back
from sie_sdk import SIEClientclient = SIEClient(api_key="API keysk-sie-…")result = client.extract( "modelMoritzLaurer/deberta-v3-large-zeroshot-v2.0", {"text": "textSIX chances to win CASH! From 100 to 20,000 pounds txt> CSH11 and send to 87575. Cost 150p/day, 6days, 16+ TsandCs apply Reply HL 4 info"}, labels=[ "labelThis text message is spam.", ], options={"hypothesis_template":"{}","multi_label":True},)print(result["classifications"])import { SIEClient } from '@superlinked/sie-sdk';
const client = new SIEClient(undefined, { apiKey: 'sk-sie-…' });
const result = await client.extract(
'MoritzLaurer/deberta-v3-large-zeroshot-v2.0',
{ text: "SIX chances to win CASH! From 100 to 20,000 pounds txt> CSH11 and send to 87575. Cost 150p/day, 6days, 16+ TsandCs apply Reply HL 4 info" },
{ labels: ["This text message is spam."], adapterOptions: {"hypothesis_template":"{}","multi_label":true} },
);
console.log(result.classifications);curl https://api.superlinked.com/v1/extract/MoritzLaurer%2Fdeberta-v3-large-zeroshot-v2.0 \
-H "Authorization: Bearer sk-sie-…" \
-H "Content-Type: application/json" \
-d "{\"items\":[{\"text\":\"SIX chances to win CASH"'!'" From 100 to 20,000 pounds txt> CSH11 and send to 87575. Cost 150p/day, 6days, 16+ TsandCs apply Reply HL 4 info\"}],\"params\":{\"labels\":[\"This text message is spam.\"],\"options\":{\"hypothesis_template\":\"{}\",\"multi_label\":true}}}"Build the "Decide yes or no" capability into my app using the Superlinked Inference Engine (SIE).
Context
- SIE is an OpenAI-style inference API. Python SDK: `from sie_sdk import SIEClient`; TypeScript: `@superlinked/sie-sdk`.
- Base URL: https://api.superlinked.com (or my regional endpoint). Auth: Bearer key from env `SIE_API_KEY` (never hard-code it).
- Model: MoritzLaurer/deberta-v3-large-zeroshot-v2.0 (SIE primitive: /extract). Keep the model id configurable.
Task
- Input: a block of text plus a set of candidate labels.
- Behaviour: return the best-matching label(s) with native scores
- Call the selected SIE primitive once per request and map the response into your domain type.
Deliverables
- A typed client wrapper, an application-level function for this task, error handling for timeouts/empty input, and unit tests with a stubbed client.
- Wire it into my existing stack (ask me which framework if unclear) and add a short usage example.classifications[0].label
This text message is spam.
classifications[0].score
0.9999Make every yes-or-no call on Serverless or beside your app
Serverless API
We host the models; you call one API.
- No idle GPUs, pay for what you use
- Fits your stack: SDK, API, CLI, MCP
- Self-host the same open-source engine
- SOC 2 Type 2, US or EU data residency
- Create an account to try Serverless
Self-hosted (Kubernetes)
Your data stays in your cloud, backed by our engineers.
- Terraform modules for your cloud
- Apache-2.0, same engine as Serverless
- GPU workers scale to zero between jobs
- Separate worker pools for each tenant
Deploy SIE to our AWS account with the superlinked/sie/aws Terraform module. Docs: superlinked.com/docs/deployment.Deploy SIE to our Google Cloud project with the superlinked/sie/google Terraform module. Docs: superlinked.com/docs/deployment.Deploy SIE to our Azure subscription with the superlinked/sie/azure Terraform module. Docs: superlinked.com/docs/deployment.Deploy SIE to our Alibaba Cloud account with the superlinked/sie/alicloud Terraform module. Docs: superlinked.com/docs/deployment. Run locally
The open-source server on your own machine.
- NVIDIA GPU
- One container, no cluster
- Process your data fully offline
- Same SDK and model IDs as Serverless
docker run --gpus all -p 8080:8080 ghcr.io/superlinked/sie-server:latest-cuda12-default