Bespoke Nimble 9B
Bespoke Nimble 9B is an open typed-decision model fine-tuned from Qwen3.5-9B. It scores user-supplied enum and boolean answers directly, supports up to 255 choices per field and an 8K request limit, and can run on Apple Silicon or NVIDIA GPUs through the project's local serving paths. Its published evaluation is narrow and partly synthetic, so probability thresholds should be calibrated on the target workflow.
Deployment and license note
Decision models return bounded choices, scores, or yes/no probabilities instead of long-form text. Public benchmark results are useful for screening candidates, but production thresholds should be calibrated on a labelled set from your own routing, guardrail, or action-selection workflow.
Task Fit
Bounded routing, classification, scoring, guardrails, and action selection with structured probabilities.
Not marked for code agent in the current library.
Not marked for code in the current library.
Not marked for chat in the current library.
Not marked for rag in the current library.
Not marked for vision in the current library.
Not marked for image generation in the current library.
Not marked for video generation in the current library.
Not marked for voice in the current library.
Source Confidence
Variants and Quant Artifacts
Choose the artifact first; hardware fit follows from RAM, VRAM, format, and runtime.
| Quant | Format | Quality | Min RAM | Reco RAM | Runtime | Action |
|---|---|---|---|---|---|---|
| BF16 | safetensors | high | 24GB | 32GB | transformers, mlx, sglang | Plan with this |
Recommended Hardware
Lowest estimated 5-year cost that can run this model.
Enough unified/system memory with a balanced 5-year cost.
Highest local performance signal among compatible hardware.
Benchmarks
Source and Review
Execution evidence
Run Bespoke Nimble 9B with a documented recipe
Recipes connect hardware, a model artifact, tools, settings, verification, and a reportable result.
No verified recipe is linked to this record yet.
Compatibility estimates remain available in the planner. A recipe appears here only after its exact stack and verification protocol are documented.