jevcal keeps Jev answers only above a measured confidence threshold

Author: Abhishek Kothari

Classification

Abhishek Kothari

Classify this use case

  • Classification0.86
  • Shipped0.89
  • Measured0.11
  • Usefulness0.54
  • Community post1.00
  • Ready0.97
  • Specific case0.68
  • Copy quality0.54
  • Creativity0.79
  • Distinct intent0.83
Result
Keeps answers at or above the lock-file threshold and leaves the rest unresolved or sends them to a fallback

Ask Jev each labelled Choice, Noul, or Score, then keep the answer only when its confidence meets the compiled threshold.

Questions

Primitive

Noul

Evaluate how true something is

Name
is_urgent
Instructions
Does this ticket need a response today?
Criteria
  • true

    The customer states a deadline, an outage, or ongoing business impact.

  • false

    No time pressure is expressed, or the customer says it can wait.

Primitive

Choice

Ask a multiple choice question

Name
department
Instructions
Which team should handle this ticket?
Criteria
  • billing

    Charges, invoices, refunds, payouts, receipts.

  • technical

    Bugs, errors, outages, integrations, login problems.

  • sales

    Pricing, plan changes, demos, procurement questions.

Primitive

Score

Set up a rubric to grade with

Name
frustration
Instructions
How frustrated is the customer?
Criteria
  • 0

    Calm or friendly

  • 1

    Frustrated or impatient

  • 2

    Very angry or threatening to leave