Brand logo
HomeCloud ComputingSecuritySoftware DevelopmentAI ApplicationsStartupsGeneral
  1. Home
  2. /
  3. general
  4. /
  5. microsoft-decision-1-9b-scoring-model-35x-faster

ItInsightsWorld Debrief: The Qwen3.5-9B Roots Behind Microsoft-Decision-1 and Its 35x Speed Claim

What Shipped on October 9, 2026 — and What Did Not

Scoring, not storytelling, is the entire product. That single design choice explains why Microsoft-Decision-1, revealed by Microsoft on October 9, 2026, deserves attention from anyone operating agent infrastructure in 2026: it is a 9B model that deliberately gives up drafting paragraphs, summaries and chat replies in exchange for one forward pass, a calibrated probability per answer option, and a decision handed straight back to the application layer.

Two details made the rounds fastest. The weights behind it start from Alibaba's Qwen3.5-9B, and distribution started inside Microsoft Foundry before OpenRouter picked the model up.

Three Things the Model Will Not Do for You

Decision-1 is text-only, will not write an explanation of its own call, and will not touch images, audio or video. Input length is capped at 32,000 tokens. If your workflow needs a written rationale or multimodal perception, you pair the scorer with a general-purpose model instead of asking it to cover that work.

Reading the Output: Probabilities as an API Contract

The practical difference from a chatbot shows up in the integration code. A conversational model hands back prose that must be parsed, with confidence guessed and formatting instructions trusted. Microsoft-Decision-1 hands back a probability distribution across options your code already defined, so no parsing step exists. The documentation's illustrative flow makes the pattern obvious: a customer message — 'My payment failed twice today.' — was offered the options billing_support, technical_support, spam, and escalate_to_human, and the example response under microsoft/microsoft-decision-1 returned 0.81, 0.11, 0.01 and 0.07 respectively.

Thresholds then become ordinary application policy rather than prompt engineering. A routing rule can read: if urgent is above 0.9 and priority is above 1.5, page the on-call engineer immediately. A conservative floor can read: if the top probability is below 0.65, do not downgrade, keep the current model, or request manual selection. Set something like route automatically above 0.75 and everything weaker goes to a human reviewer, and no text-parsing logic gets written at all. That is familiar territory for anyone who has built a classification layer with traditional machine learning, repackaged on a modern transformer base.

Calibration, though, is the part that deserves scrutiny. A worked example in the documentation shows a weighted priority score of 1.9868 at 98.08% confidence; a 90% prediction, by definition, should be right about nine times out of 10 on representative cases, and that is the standard to hold the scores to on your own data. The quickstart needs Python 3.10 or later, so a first pilot stays small, and because Microsoft describes pricing as dynamic you should confirm the current Foundry listing before sizing anything.

Why a Deliberately Narrow Product Wins Attention

October's launch cycle mostly promised assistants that talk more. Microsoft instead spent its October statement on a model built for one job: pick an item from a list, do it fast, attach a confidence number. Support tickets routed to the correct team, yes/no moderation calls on user content, pass/fail checks on an AI agent's output before it proceeds — Microsoft named routing, classification, prioritization and verification as launch use cases, plus workflow control. High-volume, low-latency work like that suits a 9B specialist far better than a full-sized reasoning model, and Microsoft is betting plenty of production systems carry that workload at scale.

The Base Model Conversation: Post-Training a Rival Lab's Weights

Commentary stuck to the foundation rather than the use case. Microsoft-Decision-1 is post-trained from Qwen3.5-9B, a 9B open-weight release from Alibaba. The Register framed it bluntly: Microsoft leaning on a Chinese AI lab's open-weight model to reach market quickly, with a stated plan to migrate the base later.

Microsoft itself did not soften that framing. Its launch post said the team "post trained Qwen3.5-9B for fast, single-pass decision scoring," and added that it "will soon rebase it on other models, including Microsoft AI (MAI) and OpenAI." Given the billions Microsoft has poured into its own model development through Microsoft Foundry and its OpenAI partnership, the disclosure reads as a speed-to-market decision on a narrow task rather than a long-term architectural commitment.

Building on somebody else's open weights is not exotic in 2026 — task-specific tools follow the same logic that pushed JetBrains to give Mellum2.1 a compact parameter count instead of raw scale. The notable part is a frontier-aspiration company attaching its own flagship name to a competitor's weights while telling customers the engine underneath will change.

The Benchmark Sheet: Vendor Numbers, Not Peer Review

Microsoft pushed hard on quantitative justification. The company says Decision-1 took the highest accuracy across a comparison spanning 36 benchmarks and approximately 150,000 held-out questions — breadth, not a cherry-picked test — and reported 83.5 percent accuracy across that evaluation, a figure the German outlet BornCity also passed along.

Latency claims got louder. AI Weekly and AI-tracking site TestingCatalog relayed Microsoft's claim that Decision-1 runs 4.5 times faster than a model it calls Quyet-1.0-Large and 35 times faster than GPT-6 Sol; a separate write-up from Data Studios led with the 35x figure. Microsoft's own launch material narrowed that to roughly 35× lower P50 latency versus GPT-6 Sol on its own benchmark, and put Decision-1 at 2.5× faster than H2O-Lightning-4B v1.1, the runner-up. Since Decision-1 scores fixed options while GPT-6 Sol generates text, that P50 comparison is far narrower than a blanket speed advantage. Taiwan's Liberty Times put response times around 85 milliseconds without naming hardware or test conditions.

Treat all of it as vendor-reported. None of the coverage reviewed included an independent, third-party reproduction of the 36-benchmark sweep, the 4.5 times and 35 times multipliers, or the 85 milliseconds latency claim. The numbers are not proven false — they are simply unaudited until someone outside Microsoft repeats the tests.

The quieter statistic may matter more in production. Per a launch summary cited by AI Weekly, Microsoft says the model's decisions were perturbation-stable 98.7 percent of the time. For any system whose binary or multi-option calls trigger automated action downstream, that is the real risk: a routing decision that flips on a trivial rewording is a production bug waiting to happen.

Pricing: Meter the Prompt, Give the Answer Away

No confirmed price appeared in Microsoft's announcement or the Microsoft Foundry documentation reviewed for this piece. What circulated came from OpenRouter's own model listing, picked up by AI Weekly and the Italian outlet Pasquale Pillitteri: $0.042 per million input tokens, with output free. A $0.042 input-only structure is coherent for a model whose entire output is a short list of probability scores — there is effectively nothing to meter on the generation side.

The positioning that follows is for high-volume routing and classification, work currently pushed at smaller general-purpose models mainly because nobody wants to pay full-model rates to ask "is this spam, yes or no." The same cost logic sits behind Anthropic cutting Claude Haiku pricing by 75 percent earlier this year: cheap and fast wins the high-frequency, low-complexity slice of API traffic even when a flagship would technically handle the job.

Access: A Preview on Foundry, a Listing on OpenRouter, No Weights

Public preview landed on Microsoft Foundry, whose documentation covers classification, routing, ranking, grading and binary decisions. The launch post first called OpenRouter availability "coming soon," yet OpenRouter's own listing confirmed the model live under microsoft/microsoft-decision-1 within roughly a day, with OpenRouter posting that it was "live on OpenRouter."

Distribution is API-only. Based on reporting from Data Studios, weights are not being released, so no self-hosting path exists — a sharp contrast with the fully open Qwen3.5-9B underneath. Commercial derivatives of open-weight models usually behave this way, but teams assuming Qwen lineage implies Qwen openness should flag the assumption.

Nadella's Own Framing and the Internal Rollout

Satya Nadella introduced the model personally on X. In his words, it "delivers top performance on structured decision tasks," "outperform[s] both LLMs and other decision models in latency and quality," and Microsoft is "already testing it across Microsoft for everything from incident response and quality control to scientific discovery." Three named internal applications, and a clear signal that the model is being exercised through Microsoft's own operations before it becomes somebody else's dependency.

Incident response is the obvious first stop — triaging alerts, scoring severity, deciding whether a ticket escalates all fit the fixed options plus confidence score shape perfectly. Quality control and scientific discovery are wider claims, and no named Microsoft executive beyond Nadella has described on the record how those workflows use the model, though Microsoft-published material has since gone deeper on other internal trials.

Trials Already Reported by the Company

Microsoft says Xbox Research used Decision-1 to sort more than 10,000 pieces of open-ended feedback into predefined themes, with quality described as competitive with GPT-5 and execution reported as 80–100 times faster. Other Microsoft-published material mentions evaluations for Copilot-response assessment and adaptive replanning. All company-reported, so they illustrate intended workload shape more than independent measurement.

Documentation also makes the target decisions concrete. One incident reads: "The checkout service has been unavailable for 20 minutes. Customers cannot complete purchases, and there is no workaround." The model scores that report against priority levels; the application decides what happens next. Foundry lists support-ticket triage, incident prioritization, content filtering, model, tool and agent selection, and model-output evaluation among supported uses.

A Microsoft developer community post extends the same idea to model selection for GitHub Copilot in CLI and VS Code, with the router surfaced in the native /model command in Copilot CLI and the Chat Model Picker in VS Code. Deployment options documented so far include Global Standard and, in selected regions, Data Zone Standard.

Neighbours in the Small-Specialist Category

Microsoft is not alone in betting that 2026 has room for task-specific models beside the frontier giants. Amazon answered with Strands Decider 2B, a 2B open-source agent model built for fast decisions and clocking around 100 milliseconds in AWS's own testing. Fewer parameters than Decision-1's 9B base and open where Microsoft-Decision-1 is API-only, but the same niche — agent guardrails and routing calls that do not need a full reasoning model.

The wider market reads like a barbell. Labs keep pushing scale, as with Mistral's Large 4 preview at roughly 1 trillion parameters or the four-tier rollout of GPT-6 inside ChatGPT, while other vendors ship cheap, narrow, fast models for the repetitive decision-making underneath those flagships. Decision-1 belongs to the second group, closer in spirit to a classifier than a chatbot despite its language-model ancestry.

Where Each Small Specialist Sits

ProductVendorScale and accessTask it servesWhat comes backCost as reported
Microsoft-Decision-1Microsoft9B, post-trained from Qwen3.5-9B; hosted APIs onlyRouting, classification, verificationCalibrated probability per predefined option$0.042/M input tokens; output not charged
Strands Decider 2BAmazon (AWS)2B, open source, self-hostableAgent guardrails, fast decisionsScored decision outputOpen weight economics
Mellum2.1JetBrains12BCode completionGenerated codeBundled with IDE tooling
GPT-6 SolOpenAIUndisclosedGeneral reasoning and generationOpen-ended proseTiered ChatGPT/API pricing
Gemini 4 ArgonGoogleUndisclosedGeneral reasoning and generationOpen-ended prose$2/$10 per M tokens (reported)

What That Lineup Really Competes On

Read together, the table says Decision-1 is not facing GPT-6 Sol or Gemini 4 Argon on the same job. It meets them on cost and latency for the slice of requests that need no generation at all: yes/no calls, A/B/C classification, pass/fail checks. If a meaningful share of enterprise AI traffic really is that mechanical, a cheap specialist could siphon surprising volume from general-purpose APIs without ever producing a sentence of prose.

Back to the Shape of Old-School ML

Decision-scoring is closer to a return to form than an invention. Before the generative boom, production machine learning was mostly classifiers, rankers and scoring models trained for one narrow task. The generative wave of 2022 through 2025 pulled engineering attention toward chatbots and generalist agents, and paid for it in latency and unit cost on simple work. Products such as Microsoft-Decision-1 and AWS Strands Decider 2B mark an industry correction: frontier model only when open-ended reasoning is genuinely required, small and cheap and fast when it is not.

The "LLM-as-judge" pattern, where a language model grades another model's output, has anchored evaluation pipelines for a couple of years. The shift in 2026 is packaging: vendors sell it as dedicated, priced infrastructure rather than something developers hand-roll with prompt engineering. Microsoft's own framing of Decision-1 for "AI judging" and "agent guardrails" sits squarely in that lineage.

Pressure Points Across the Market

The most direct squeeze falls on vendors selling general-purpose models for routing and classification work that customers are overpaying for relative to actual complexity. Redirecting high-volume, low-complexity calls toward purpose-built scorers dents token revenue for anyone charging full-model rates on tasks that never needed full-model reasoning.

Google and Anthropic face the mirror question: name a decision-scoring product of their own, or fold the capability into existing lightweight tiers. Google has been tightening its free-tier lineup, visible in Gemini 4 Argon's pricing and benchmark split this year, and Anthropic's Claude Haiku cuts point the same way — hold frontier pricing up top, compete hard at the volume-rich bottom.

Then there is the cloud angle. Microsoft Foundry is the platform through which the company sells AI compute and model access to enterprises, and cheap, high-volume, sticky workloads such as routing and classification are precisely what keeps customers inside one ecosystem instead of shopping API calls between providers. A $0.042-per-million-token product, if it performs as claimed, could turn into a quiet volume engine for Foundry.

How to Pilot It Without Getting Burned

Start where the answer set is already closed — a ticket queue, a model picker — and score against past human decisions long before any output is allowed to trigger action automatically. Log confidence alongside the chosen option from day one, so calibration claims are measured on your traffic rather than assumed. Re-check the current Foundry listing at pilot time, since pricing is described as dynamic. And keep the benchmark sheet at arm's length: every multiplier and latency figure in this story is Microsoft's own until an external lab repeats it.

Brand logo

IT Insights

Cloud & Infrastructure Practice Media for Enterprise Technology Decision-Makers

Cloud ComputingSecuritySoftware DevelopmentAI ApplicationsStartupsGeneralAI Data News Global

© 2026 IT Insights.

Cookie Notice

We use cookies to improve your experience and analyze website traffic. Read our Privacy Policy to learn more.