Jev validates Near Here event listings at 96 percent on 50 cases
Classification- Cost
- $0.043 per 1,000 decisions
- Latency
- 0.59s average; 0.58s median on the 21-record run
- Result
- 48 of 50 expected decisions on the main test set
Ask Jev a Choice on whether a listing title and optional description should be excluded from Near Here after deterministic checks.
Ask Jev a Choice on whether a listing title and optional description should be excluded from Near Here after deterministic checks.
The cited post compared that Choice with Mistral Small 4 and Gemini 3.5 Flash-Lite on the same 50 listings. Jev matched 48 of 50 expected decisions and rejected none of the 13 expected-valid events. Mistral matched 42. Gemini matched 43.
Speed and cost come from a separate 21-record run: Jev median 0.58s and $0.000904 for those 21 listings, or $0.043 per 1,000 decisions. The post says the prompts were selected for prospective production use, not that they were already deployed.
How it works
- Run deterministic checks on each listing
- Send the title and optional description to Jev as a Choice
- Exclude listings Jev assigns to a rejection category
- Keep listings with no explicit exclusion