Jev 以約 300 ms p50 分流 Notra 聊天
分類- 延遲
- ~300 ms p50 / ~550 ms p95
- 結果
- 布林答案以 0.5 設門檻
對每則 Notra 聊天訊息問 Jev 複雜度 Choice，加上工具與推理偏重 Noul，再以 0.5 門檻選模型。
問題
Primitive
Choice
Ask a multiple choice question
- Name
- complexity
- 指示
- How complex is the task in userMessage?
- 準則
- simple
Single-step task, quick edit, straightforward change, greeting, or simple question
- complex
Multi-step task, content creation from scratch, research, analysis, or a task requiring reasoning
- simple
Primitive
Noul
Evaluate how true something is
- Name
- requiresTools
- 指示
- Does fulfilling userMessage require using tools (editing the current draft, fetching data from connected sources, accessing skills, publishing or scheduling)?
- 準則
- true
Any editing, data fetching from connected sources, skills, or explicit requests to run tools
- false
Answering questions, explaining concepts, or conversation
- true
Primitive
Noul
Evaluate how true something is
- Name
- reasoningHeavy
- 指示
- Is the task in userMessage reasoning-heavy?
- 準則
- true
Deep analysis, long-form writing, multi-source research, architectural decisions, nuanced critique, comparative synthesis
- false
Everyday chat, quick edits, factual lookups, straightforward content generation
- true